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THE RELATIONSHIP OF PROBLEM-SOLVING STYLES 
TO THE FACTOR COMPOSITION OF TESTS 


Abstract 


This study was undertaken to learn more ahout the way in which the eharae- 
teristics heing measured by a test vary with the kind of examinee taking the 
test or with the problem-solving style he uses in approaching test problems. 
Briefly, the procedure for this study included the following steps: 

( 1 ) The subjects took 15 tests which would later be examined by factor analysis. 

(2) In order to find out what problem-solving styles the subjects used, they 
were required to fill out a questionnaire about their background and their 
approach to test problems, and were interviewed while they solved items similar 
to ones they had faoed on the tests. In all, more than 100 items of infomatlon 
about each subject were gathered. (3) As ah aid in recognizing the important 
problem solving styles in these data, the intercorrelations of the Interview, 
questionnaire, and test variables were factor analyzed. .(k) These variables, 
after being grouped and selected by the factor analysis, were used to divide^ 

jects into 17 different pairs of subsamples representing different 
problem-solving styles or different background characteristics that might be 
expected to affect the way In which a person solves problems. (5) All subssm^.les 
in the 17 pairs and also the whole group were then used In performing separate 
factor analyses of the same 15 tests, in all of which five factors were extracted 

and rotated. ( 6 ) Factor loadings and factor Intercorrelations were compared for 

the t¥o subsamples in each pair- 

The problem-solving approaches used for dividing many of the pairs of sub- 
esmples distinguished some kind of systematizing approach from a scanning 
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approach. This IS a distinction emphasized hy Bloom and Broden and prohahly 
related to Gardner's Focusing vs. Scanning and Vitkin's Analytic Attitude or 
Field-Independenee. While some of the divisions into pairs of suhsamples 
revealed no substantial differences either in the loadings of the 15 tests on 
the five factors or in the intercorrelations of the factors^ many Interesting 
differences occurred. In particular the development of a systematic approach 
to solving the items of a test frequently reduced the loadings of that test on 
the factor which usually characterized it best. AIsOj for subjects using a 
systematic rather than an intuitive or scanning approach to test items; the 
space factor was usually found to be relatively less correlated with the verbal 
and mathematical factors and the verbal and mathematical factors were found to 
be more highly correlated with each other. An attempt is made to account for 
these findings psychologically hy supposing that systematic persons develop 
specialized techniques for solving the visible; concrete spatial problems that 
are quite different from the spholic techniques that they can use for solving 
problems in either of the spbolic areas; verbal and mathematics. 
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THE RELATIONSHIP OF PROBLEM-SOLVING STYLES 
TO THE FACTOR COMPOSITION OF TESTS^ 

When an ahility or achievement test is constructed;, its author usually 
assumes; or at least hopes; that his creation will measure the same thing for 
all examinees. An often talked about exception to this desirable quality of 
a test IS the case of a fourth grader and a college student who take the same 
test of addition. We think such a best is one of reasoning for the younger 
subject; while it is one of speed for the older one. Some specific data on 
this appears in Balinski (l9^ll) • Large age differences; however; are not the 
only differences that affect the nature of the factor being measured by a test. 
Some tests of higher mental processes are solved in one way by some subjects 
and in another way by other subjects (Bloom 80 Broder; 1950j Ch. 3j Lucas; 

1953)* This means that the tests may be measuring different abilities for some 
subjects than for others; and so it follows that tests will have different 
correlations with one another for different kinds of groups of subjects. There¬ 
fore; since factor loadings of the tests depend on these correlations; we cannot 
expect factor loadings to be invariant from one population to a different popu¬ 
lation (Thurstone; IShj, p. 360)" It seems possible that the factorial compo¬ 
sition of test problems involving higher mental processes often appears complex; 
not only because they require several different kinds of abilities in their 
solution; but also because they measure something different for examinees who 
solve them by using different methods. This study was initiated because an 
investigation of this situation seemed likely to lead to worthwhile information 
about individual differences in problem-solving styles; an appreciation of the 
different things a test measures for different subjects; and an understanding 
of the extent to which factor analysis reflects qualitative differences in 
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individuals' reactions to tests as "well as to difrerences in the nature oT the 
tests themselves. 

Briefly^ the procedure I'or this study included the following steps : 

(l) The subjects took 15 tests which would later be examined by factor 
analysis, ( 2 ) In order to find out what problem-solving styles the subjects 

usedj they were required to fill out a questionnaire about their background 
and their approach to test problemsj and were interviewed while they solved 
items similar to ones they had faced on the tests. In all^ more than 100 items 
of information about each subject were gatliei'ed. ( 3 ) As an aid in recog¬ 
nizing the important problem-solving styles in these data^ the intercorre¬ 
lations of the interview,, (fuestionnaire,, and test variables were factor 
analyzed. (4) These variables^ after being grouped and selected by the factor 
analysis; were used to divide the subjects into I 7 different pairs of sub- 
samples representing different problem-solving styles or different background 
characteristics that might be expected to affect the way in which a person 
solves problems. ( 5 ) All subsamples in the 17 pairs and also the whole group 
were then used in performing separate factor analyses of the same 15 tests, 
in all of which five factors were extracted and rotated. (6) Factor loadings 
and factor intercorrelations were compared for the two subsamples in each 
pair. 

Before the work was started^ the following hypotheses about specific 
tests were written down; 

1. Verbal Analogies will give rise to a reasoning subsample and a 
knowledge subsample. For the reasoning group as compared to the knowledge 
group, Verbal Analogies wil], load the mathematics reasoning factor higher, 
and the mathematics reasoning factor will have a higher correlation with the 


verbal factor. 
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2. Cub@Sj Spatial OriGntation., and. Punclied Hole .5 will give rise to a 
spatial sense subsample and. a verbal reasoning sub sample. Por the spatial 
sense group as compared to the verbal reasoning group, the spatial and 
visualization factors will be more orthogonal to the mathematics reasoning 
and verbal factors, and the group means for the spatial and visualization 
tests will be higher. 

3- Letter Grouping and Number Series will give rise to a system sub¬ 
sample and a trial and error subsample. For the system group there will be 
an induction factorj for the trial and error group bhere will not. 

4. Mathematics Problems will give rise to an original reasoning sub- 
sample and a text-bo ok methods subsample. For the original reasoning group 
there will be a mathematics reasoning factor; for the text-book methods group 
the re will not. 

Later in this report these hypotheses will be compared with the experi¬ 
mental results. 

Selection of Tests 

It was considered desirable to select tests known to have loadings on 
factors which are of general Interest to researchers, which are involved in 
cognition rather than perception or pure speed, and, preferably, which have 
some demonstrated importance in intellectual achievement. A history of some 
confusion in the inteip^retation of a factor was regarded as an asset in this 
kind of study, since this left wide open the possibility that differences in 
problem-solving styles would affect factor loadings. It was also considered 
desirable to use some tests that straddle two or more of these factors. The 

five factors that were selected and the five tests selected to represent them 
most purely are as follows: 




Factor 


"Pure" test 


Verbal Comprehension 

General Reasoning 

Space 

Induction 

Visualization 


Vocabulary 
Mathematics Problems 
Cards 

Letter Grouping 
Surface Development 


A selection was made of ten other tests which would load these factors less 
purely or would straddle two or more of them. The 15 tests are named and 
described below. The items that were used in the interview situation are 


presented in Appendix A. These items will serve as samples ofthe hinds of 
items in the test battery, although these particular items do not appear in 
the tests themselves. Sample items from Vocabulary and from Ship Destination 
are missing, because these were not used in the final foirni of the Interview. 
Following each test name below, appear the code letters that will be used to 
refer to these bests. Information about factor loadings previously found for 
all of the tests may he found in French (l95l)- A phrase indicating the factors 
usually found to be associated with each test is given at the end of the test 
description. 

1. Vocabulary, VOC 

A 5-cholce synonym test of general vocabulary having a moderabely 
wide range of item difficulties. 36 items, 7 minutes. Pure on Verbal 
Comprehension. 

2. Mathematics Problems, MAT 

A test of fairly conventional word problems all of which are solvable 
by arithmetic, but for a few of which the use of simple equations would 
help. 15 5-choice items, 15 minutes. Pure on General Reasoning. 

3 . Cubes, CUB 

A Thurstone test in which each item presents 2 drawings of a cuhe 
with designs on its faces. Assuming no cube can have 2 faces alike, the 
subject indicates which items show 2 drawings that can he of the same cube 
and which ones show 2 di-awings that cannot be of the same cuhe. 4^ items, 

5 minutes. Space with some Visualization and Induction. 
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h. Funche d Hole s , PXJM 

A Thurstons test in which each item includes successive drawings 
illustrating 2 or 3 folds made in a square sheet of paper. A drawing of the 
folded paper shows where 1 or 2 holes are punched in it. The subject draws 
the sheet as it would appear fully opened. 10 items, 5 minutes. Mainly 
Visualization. 

5. Letter Grouping, LET 

A form of Thurstone's test in which each item presents 4 sets of h 
letters each. The task is to find the rule which relates 3 of fhe sets to 
each other and to mark the one which does not fib the rule. 25 items, 3 
minutes. Pure on Induction- 

6. Surface Development, SUR 

This is Thurstone's test in which there are drawings of solid geometri¬ 
cal forms. With each drawing there is a diagram showing how a flab pattern 
might be cut and folded so as to make the solid form. The subject is to 
indicate which lettered edges on the solid form correspond to numbered edges 
or folds in the pattern. 12 patterns totalling 60 items, 10 minutes. Mainly 
Visualization. 

7. Verbal Analogies, VER 

Each item consists of 2 words which have a certain relationship to each 
other followed by 5 numbered pairs of related words. The task is to circle 
the one of the numbered pairs which illustrates the same relationship as the 
original pair. l6 items, 10 minutes. Verbal Comprehension with some In¬ 
duction and General Reasoning. 

8. Ship Destination, SHI 

A test by Christensen and Guilford in which the task is to use knowledge 
of the position of a ship in a diagram with respect to a port, knowledge of 
wind direcbion, ocean current, and direction of travel to compute effective 
distance to port following given rules. 48 items, 15 minutes. General 
Reasoning with some Space. 

9. Cards, GAR 

A Thurstone test in which each item gives a drawing of a card cut in 
some shape and sometimes having holes punched in it. To its right are 6 
other drawings of the card, some merely of the card in different rotational 
positions and some of the card turned over. The subject indicates which 
ones are "like" the stimulus card (not turned over). l8 cards, 108 scorable 
units, 5 minutes. Pure on Space. 

10. Reading, REA 

Four paragraphs representing different kinds of reading were the basis 
on which the subjects responded to a total of 15 5-cholce questions. 

15 minutes. Verbal Comprehension with some General Reasoning. 

11. Concealed Figures, COW 

An adaptation by Thurstone of the Gottschaldt Figures Test . Each row 
of the test has a simple geometrical figure at the left side followed hy 
4 complex figures. The task is to mark each complex figure whether It does 
or does not contain the simple figure. 42 rows, 168 scorable units, 8 
minutes. Space with several other factors. 
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12 . Figure Analogiesj FIG 

One of 5 geometrical figures is to be selected as the fourth term 
in a proportion such that it hears the same relation to the third term 
as the second did to the first. 30 items, 5 minutes. General Reasoning, 
Induction, and Space, 

13. Spatial Orientation, SPA 

Each item presented 2 drawings of shore objects as seen over the prow 
of a boat. By comparing the position of shore objects with respect to the 
prow bhe subject was to judge the vertical, horizontal, or tilting motion 
of the boat between pictures. The subject reacted by choosing 1 of 5 
responses, each of which showed a dot representing the first position of 
the prow and a dash representing the second. 5^ items, 10 minutes. Two 
additional scorings of this test concerned separating the errors made in 
recognizing tilt from errors on other aspects of the test. Space and 
Visualization. 

14. Rumher Series, RUM 

Each item consisted of a series of seven 1- or 2-digit numbers. The 
eighth member of the series was to be selected from among the 5 choices 
offered. 30 items, 10 minutes. General Reasoning with some Induction. 

15. Marks, MAR 

A test by Thurstone in which each item gives 5 rows of places and gaps. 
In the first 4 rows one place is marked according bo a rule. The task is 
to discover the rule and to mark one of the places in the fifth row 
accordingly. 20 items, 8 minutes. Induction with some Space and General 
Reasoning. 


Administration of the Tests 

The tests were administered to male students in the eleventh and twelfth 
grades of the college preparatory program at Princeton (Uew Jersey) High School 
and students enrolled in Princeton University. These subjects were paid for 
their participation in the experiment. A total of about 220 took the tests; 

177 were used in the analysis. 

To make it possible to schedule an individual Interview with each subject 
within a few days after the testing period it was necessary to spread the testing 
out, one or two subjects being tested at a time. This was done by having them 
take the tests individually by timing themselves with an electric timer. 
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The Interview and Questionnaire 

The items shown in Appendix A, which are like those in each of the 15 tests 
except Vocahulary and Ship Destination, were presented to each of the subjects 
individually within a few days after he took the tests. The subjects were asked 
to respond bo each item, doing all their thinking aloud. In addition, the inter¬ 
viewer asked a few specific questions which seemed helpful in reaching a satis¬ 
factory understanding of the subject's methods or styles in solving each kind of 
problem presented to him. 

The interviewing procedure was built up and continually revised during the 
processing of about 4o subjects whose test scores and interview protocols were 
not used in the analysis. During this period it was decided what kinds of things 
should he observed, what test items were best able to bring out a subject's 
characteristic behavior, and what questions should be asked in order to facilitate 
interpretation of the subject's methods for solving the problems that were set 
for him. Although the decision on the kinds of behavior to he recorded was 
decided entirely on the basis of what seemed especially distinctive during the 
interviews, there was, nevertheless, a relationship between the kinds of behavior 
observed m this sbudy and characteristics of problem-solving behavior reported 
in the literabure and discussed in the next section. 

Items from the Vocahulary and Ship Destination tesbs were not used in the 
Interview, because no satisfactory differences in mebhods of working on these 
tests could be observed. 

During the course of the development of the procedure, some 20 interviews 
were carried out Jointly by the writer and the interviewer, who made independent 
Judgments of the subjects' responses. When substantial disagreement occurred, 
interview test items were changed or eliminated, the nature of the ratings were 
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redefinedj or special questions lor the subject were incorporated in the 
interview procedure. The rinaJ. interview form including the special questions 
IS presented in Appendix B. A measure of reliability of the interview obser¬ 
vations in their final form made by correlating the judgments of two observers 
would have been desirable; but would have added very substantially to the cost 
of the project. 

The interview yielded IO 5 ratings or variables. Some of these were 
necessarily dichotomous because of their essentially qualitative nature; some 
of them were ratings on a 3-point to 7-point scale or were enumerations of 
specific ideas or words spoken hy the subject. A multi-point scale was used 
for a rating whenever possible in order to permit conversion to a dichotomy with 
which the group of subjects could be split into two nearly equal divisions. 

After the interview^ the subjects completed a questionnaire asking them 
about their school and home interests; academic interests and background; their 
abilities; their ambitions; and the way they themselves thought that they solved 
problems. While most of these questions did not pertain directly to problem¬ 
solving stylesj they concerned characteristics of the individuals that might be 
expected to relate to problem-solving styles. In any case it was thought best 
not to limit the definition of suhsamples entirely to the interview observations 
The questionnaire is included as Appendix C. It yielded an additional 32 
variables. Most of these consisted of an item that could he checked or not 
checked or an activity that could be named or not named. That isj most of the 
variables yielded hy this questionnaire were dichotomies; many of which; however 
split the total group of subjects into poorly balanced subgroups. 
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The Selection of the Experimental Dictiotomies 

Experimental diehotoraies constructed from single variables or combinations 
of variables were to be used for dividing the total sample of subjects into 
pairs of contrasting subsamples. Since the interview and questionnaire provided 
a total of 137 variables, it seemed neither wise nor possible bo decide about 
the dichotomies on the basis of simple inspection or common sense. 

All variables which were not already dichotomies were dichotomized as 
closely as possible to the center of their distributions. The I5 test scores 
plus two extra scores for the Spatial Orientation test were also dichotomized. 

For the resulting dichotomies the matrix of tetrachoric intercorrelations 
based on 177 cases was computed. Variables shown by these correlations to be 
mere repetitions of others and also some variables for which the split was 
particularly unbalanced were now dropped from further analysis. The remaining 
125 variables were factored. While the ratio of 177 cases to 125 variables is 
extremely small, factor analysis was considered to be a reasonable procedure 
because it was being employed in this instance merely as a technique to suggest 
groups of variables that could be combined into short, rough scales for sepa¬ 
rating the subjects into pairs of subsamples. Twenty-five principal component 
factors were extracted using communalities estimated by iteration. The decision 
to stop extracting factors was based on the size of the eigenvalues. The factors 

E 

were then rotated orthogonally by the varimax: method. While the total group of 
subjects could have been divided into subsamples on the basis of any one of the 
variables, each of these 25 factors was thought to represent a particularly 
fruitful independent basis for the division. Actually only the I7 factors which 
seemed to have psychological meaning were used for this purpose. 
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Because of the enormity of the tables of intercorrelations and factor 
loadingsj they will not be reported here. Some of the information from these 
tables, however, is used to describe the pairs of subsamples that were created. 
The tables headed "Pair 1," "Pair 2," etc. are devoted to each of these pairs 
of subsamples derived from 17 of the 25 factors. The heading of each table also 
contains the name of the factor (pair) and the names of the 1, 2, 3j or 5 
variables on the basis of which the total sample of subjects was divided into 
two subsamples. These variables are ordinarily the ones with highest loadings 
on one of the 17 factors, although variables highly correlabed with one another 
were sometimes avoided. For Factor 1 a special exception was made. For bhis 
factor the test scores themselves had bhe highest loadings. Since it was the 
test scores that were used in the subsequent part of bhe analysis, the division 
was made on the basis of the highest non-test variables. These happened to be 
interview variables concerned with mathematics problems. Finally, in the top 
part of each table, the factor responsible for the division is further described 
by presenting its loadings for college vs. high school and its loadings for the 
test scores that are of particular interest. (The 17 "pair tables" are located 
on pages 23-39.) 

Inspection of the headings on the I7 "pair tables" will show that many of 
the subsample divisions, while being developed from orthogonal factors, never¬ 
theless seem to fall loosely Into a category thab can be called "systematiaing" 
or "analyzing" vs. "scanning." The pairs in this category are Numbers 2, 5j 
6, 7, 8, 11, 15, 16 and 17- Other pairs are as follows: 

Pair 1, which is divided by an aptitude, mathematics or, perhaps, something 
more general, is the one mentioned in the preceding paragraph. 

Pairs 4 and I3 are divided by Interest variables: interest in verbal 
subjects and in art, respectively. 
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Palrs 9 and. 12 are activities peculiar to the reading test. Pair 9 can^ 
perhapsj also "be considered to represent a kind of systematizing. 

Pair ll+^ represents a lack of visualization indications. It could be con¬ 
sidered a kind of negative measure of systematizing, but there were not adequate 
negative correlations to justify this. 

The prevalence of problem-solving styles that seem concerned with systema¬ 
tizing or scanning suggests that there may be a relationship between the problem¬ 
solving styles observed in this experiment, particularly for the spatial tests, 
and the cognitive style of focusing vs. scanning which has been found to effect 
perception of size and susceptibility to illusions (Gardner et al., 1959 i Gardner, 
1961; Gardner &: Long, I962), 

Since the various kinds of systematizing observed in this study were es¬ 
sentially uncorrelated with one another, being derived from orthogonal factors, 
they will be regarded as separate problem-solving styles. It is possible that 
different kinds of tests or techniques of observation would yield approaches to 
problems that seem psychologically to be less alike. Especially for Pairs 2 , 7 , 

0, 15, and 16 the observed problem-solving style can best be termed "analyzing" 
in contrast to a global way of perceiving. A dimension which sounds like this 
as it is described has been discussed by Witkin et ol. (1962) and has been found 
to be generally positively correlated with intellectual ahility (Witkin et al., 
195^, 1962j Gardner, Jackson, & Messick, i960). The means of the subsamples given 
at the bottoms of the "pair tables" confirm this positive relationship con¬ 
sistently. However, the analytic approach was not found to he consistently suc¬ 
cessful for spatial tests or even for the tests with which the analytic behavior 
was observed. In particular, the suhsamples using analytical behavior on con¬ 
cealed Figures (Pair 8 ) and Cubes (Pair I5) made lower mean scores on those tests 
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than did the suhsEunples u&ing global behavior. Since Concealed Figures is very 
similar to the test that Witkln and his associates used for measuring Analytic 
Attitude or Field-Independence; there appears some doubt that the behavior being 
observed here iSj in fact; the same as that described by Witkin. 

Factorization of the Subsamples 

After the 3 ^^ subsamples had been defined, as indicated at the top of the 
17 "pair" tables, the matrix of Intercorrelations of the I5 test scores for each 
of these subsamples and for the total sample were factored. In all cases five 
factors were extracted. To stipulate the same number of factors in advance for 
all 35 analyses effected a considerable saving in cost. The nuniber five was 
used because the tests had been chosen so as to include variance from five known 
factors. Examination of the eigenvalues and residuals gave no indication that 
a different number of factors would have been preferable. 

The first rotation for each of the 35 factorizations was by varlmax to an 
orthogonal solution. Again, because of space considerations, it is impossible 
to report the 35 sets of intercoirelations and factor loadings, unrotated or 
rotated. The intercorrelations and the varlmax rotated solution for the whole 
group is shown as Appendix D. Many but not all of the subsample solutions looked 
very much the same as the solution for the whole group. That is, the five factors 
as they appeared in many (but not all) of the subsamples justified similar factor 
names, and the individual tests had similar patterns of loadings. For other sub- 
samples, however, the loadings of all tests simultaneously veered away from the 
loadings that had been found for the total group. Comparisons from one subsample 
to another were completely without precision. Since precise comparisons of factor 
loadings were of central importance to this study, a rotational technique which 
Insured congruency of the factors was essential. To achieve this, it was planned 
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to rotate four of tlie factors to specified marker variables that -would define 
the positions of the factors. With one exceptionj the marker variables selected 
were those with the highest loadings in the varimax solution for the whole group. 
The Concealed Figures test^ GONj actually had the third highest loading on a 
factor recognized as a Space-Visualization factor^ but this test was not used 
as a marker, because it has not always been clearly identified with Space or 
Visualization. The marker tests used were as follows: 

Factor A: PIM, SUR, and CAR 
Factor B: VOC, VEEj and REA 
Factor C: MAT and WUM 
Factor D; SHI and MAR 

Factor E was rotated so as to be orthogonal to A, B, C, and D. 

A quartimax rotation was applied first to produce the best orthogonal 
rotation to the four sebs of marker bests. Factor E was then permanently set 
orthogonal to these four. A patterned oblimax rotation was then applied to 
Factors A, B, C, and D to bring these factors as close as possible to the marker 
tests. ^ 

With the exception of Factor E, the resulting rotabions were oblique, often 
extremely oblique, correlations between factor axes ranging from .28 to .00. 

While a good many incomprehensible differences could still be found in the factor 
patterns when comparing one subsample with another, the picture was greatly 
clarified. The principal variables identifying the factors retained pretty much 
the same loadings from subsample to subsample, while single tests would shift 
their highest loadings from one factor to another or the Intercorrelations among 
the factors would change. 

For the total sample. Table 1 shows the loadings for the oblique rotation and 
the Intercorrelations of the factor axes. The factors have been named as follows: 
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Table 1 

Factor Results for the Total Sample 


Factor loadings after rotation determined by marker tests (denoted by ) 


- 

Test Name 

Code 

A 

Factor Loadings 

LCD 

E 

1. 

Vocabulary 

VOG 

-.01 

.68* 

-.00 

-.11 

.02 

2. 

Mathematics Problems 

MAT 

.11 

.22 

. -Sf 
.111 

-.08 

-.15 

3 . 

Cubes 

CDB 

.11-6 

•17 

-.i 4 

.01 

,21 

li-. 

Punched Holes 

PUH 

, 4-2 

-.01 

.01 

-15 

-.07 

5 - 

Letber Grouping 

LED 

.10 

.07 

.25 

.08 

.^5 

6 . 

Surface Development 

SUR 

.80'' 

.08 

-.10 

-.17 

- .06 

7 - 

Verbal Analogies 

VER 

•03 

^ -Jf- 

.60 

-.03 

-.02 

-.04 

8 . 

Ship Destination 

SHI 

.06 

.16 

.05 

1—I 
m 

* 

-.02 

9 . 

Cards 

CAR 

* 

•57 

-.08 

.03 

-.01 

.10 

10 . 

Reading 

REA 

,02 

.62* 

-.08 

.04 

.03 

11 . 

Concealed Figures 

COH 

.43 

.02 

-.02 

■15 

.11 

12 . 

Figure Analogies 

FIG 

. 4 o 

.06 

-.02 

.15 

.06 

13 - 

Spatial Orientation 

SPA 

-37 

■17 

-.09 

.12 

-.05 

i4. 

Humber Series 

HUM 

-.10 

-.11 

■ 63 

.02 

.o 4 

15 - 

Marks 

MAR 

-.12 

-.08 

-.00 

■ 52 

.00 


Correlation of factor axes; 









- 15 - 


Factor A , (marked by PUNj SUR, and CAR). Space-Visualization. In selecting 
the 15 tests for this study; it -was intended that Space and Visualization would 
appear as separate factors; but they did not do so. As could be seen from factor 
plots made from the data in Table 1 and from the data for some of the subsampleS; 
the spatial and visualization tests are intermingled. Therefore; failure to 
isolate the two factors is not merely a defect of the rotation. 

Factor B ; (marked by VOC, VER; and REA) . Verbal Comprehension. 

Factor G ; (marked by MAT and MJM). Mathematics. MAT was intended to 
associate with SHI to define the General Reasoning factor as it has in many studieE 
carried out in Guilford's laboratory (Green et al., 1953 i Frick et aJ..; 1959 > etc.) 
but it did not do so. Its association with MJM is reasonable; but the factor seemt 
to be one of number facility or mathematical content rather than one of pure 
reasoning. 

Factor D ; (marked by SHI and MAR). Reasoning. If MAR and LET had appeared 
on the same factor; it could have been interpreted as induction. However; since 
SHI IS a reasoning test but probably not a test of inductive reasoning; it will 
serve the purposes of this study to call Factor D a reasoning factor without 
specifying what kind of reasoning is involved. 

Factor E j (orthogonal to A, B, C, andD). No interpretation. LET has the 
highest loading; but data for making an interpretation are very slight indeed. 

The matrix of factor loadings in Table 1 may be compared with the results 
given for the subsamples. Only selected figures are given for the subsamplesj 
otherwise the mass of numbers would make comparisons very cumbersome. The table 
for each pair presents the following data for each subsample: 

1 . Loadings of .20 and higher for each of the five factors. 

2 . All loadings for tests involved in defining the subsamples. 

These appear in parentheses when less than . 20 . 
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3. Intercorrelations of factor axes. 

4 - The suhsample mean and standard deviation for some of the tests including 
those involved in defining the subsample. These are given to provide a 
fuller understanding of the kind of subjects falling into each subsample. 

Discussion of the Subsample Results 

Pair Ij Has Less vs. More Trouble with Mathematics Problems . The highest 
loadings for the factor resulting in Pair 1 were among the test scores themselveSj 
but these were not used in defining the division of subsamplebecause doing so 
would create some spurious restrictions of range. Nevertheless, this mathematical 
factor is closely related to general intellect and maturity in this group. Wot 
only for Mathematics Problems, MAT, but for all of the tests, the mean scores 
given in the lowest section of the table are higher for the subjects who had "less 
trouble with Mathematics." Even though the variables used in creating this pair 
of subsamples are interview variables, the distinction made here is more one of 
problem-solving capability than of problem-solving style. 

The primary effect of this factor was to concentrate the students with mathe¬ 
matical ability into one subsample to such a degree that the distribution of MAT 
scores became crushed against its ceiling of 15 - This effect reduced the variance 
on MAT and caused it to drop from its usual place in bhe factor pattern. Look 
first at the group having "more trouble" and then at the group having "less 
trouble" with Mathematics. Factor C, which was called "Mathematics" for the 
total group, has become dominated by Letter Grouping. It has moved away from (has 
a lower correlation with) Space-Visualization and has moved toward Verbal Compre¬ 
hension. This change is reasonable, because the new Factor C, consisting of 
Letter Grouping and Number Series, is probably inductive in nature calling for 
the formation and trial of hypotheses. 


Such an activity certainly requires less 
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spatial visualization than the mathematics problems, and the mental manipulation 
of hypotheses in verbal terms may account for its raised correlation with Verbal 
Comprehension. It is possible that there would have been no disturbance in the 
factorial pattern for this pair of subsamples had it not been that MAT was too 
easy for these subjects. In factor studies it is usually hoped that there will 
be factorial "invariance"; that iSj it is hoped that the nature of the factors 
will be relatively independent of the particular tests included in the study. 

In an instance of this kind where one test was in effect simply deleted from the 
battery, the factors would usually be expected to remain invariant. However, 
invariance failed to appear, probably because there were not enough tests to 
define the factors. Without a we11-functioning mathematics problem test, there 
was not enough common variance in mathematics to define a factor. 

Pair 2, Uses Rule in Solving Cards Items . Division of the sample into a 
pair of subsamples according to whether or not the subjects used a rule for 
analyzing Cards items produced no appreciable differences in the factor loadings 
or any large differences in the intercorrelations among factors. The reason for 
a negative result for this pair of subsamples, or for any other pair of subsamples, 
cannot, of course, be fully determined. The implication here is that Cards 
measures close to the same thing whether or not the subjects use a rule in 
responding to the items. It is possible, however, that the interview simply 
failed to make any reliable discrimination with regard to behavior on this 
particular test. 

Pair 3, Emphasizes Relationships in Humber Series Items . This division, 
based on the use of relationships in solving Humber Series, HUM, problems has 
affected. Factor C, the mathematics factor. The loading of the Mathematics 
Problems test has declined sharply on Factor C. Since the division of subsamples 
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is based on WUM, a more reasonable interpretation is that HUM moved away from 
the mathematics lactor and is norr forming a new Factor C, which appears inductive 
in nature. This leaves no factor that can be interpreted as Mathematics. This 
is the first of several pairs of subsamples showing that a systematic approach 
to a test tends to move the test away from the factor or other tests with which 
it is more usually associated. 

Fair 4j Likes Verbal Subjects vs. Likes Science . This division produced no 
important differences^ unless the reduction in the loading of Marks on Factor D 
can he considered significant - The pattern of mean test scores shows that those 
who like verbal subjects best did bettor on Vocabulary^ while those who like 
science best did better on all of the other tests. 

Pair Uses Hypotheses for Letter Grouping Items . Although the loading of 
Letter Groups, LIT, rose somewhat on Factor E no very important differences in 
factor loadings or intercorrelations appeared for this pair of subsamples. It 
IS of interest to note that use of hypotheses on LET is associated with slightly 
lower ability on all of the tests Including LET. This contrasts with most of the 
other pairs where use of rules, hypotheses, and systems are associated with higher 
test scores. Gince this test was fairly easy, the better subjects may have 
realized that the methodical trJal of hypotheses on it was wasteful of time. 

Pair 6, Uses Hypotheses X'or Marks Ttems . As for Pair 5 use of hypotheses 
is here associated with lower general ability as indicated by most of the test 
scores. However, in this case, use of hypotheses with Marks seems to help scores 
on that test slightly. For the suhsample of persons who use hypotheses on Marks 
there is a much lower correlation between the "Marks factor," Factor D, and Verbal 
Comprehension. This finding is discussed further for Pair I7• 
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Fair 7, Uses Reasoning for Spatial Orientation Items . As seems reasonable,, 
the use of reasoning for a spatial test shifts the highest loading for that test 
from Space-Visualizatiouj Factor A, to a reasoning factor, Factor D. The effect 
has been to push Factor D away from Verbal Comprehension, the correlation between 
these two facbors dropping from >79 to .22. There seems to be no obvious expla¬ 
nation for this, although the same drop in correlation between Factors D and B 
appeared also for Pair 6. For both Pairs 6 and 7 the loading of Ship Destination 
on Factor D drops sharply. Strictly speaking, therefore. Factor D is not the 
same factor in both subsamples. 

Pair 8, Uses Details of Figures in Concealed Figures Items . The pattern of 
factor loadings is essentially unchanged by this division. However, going from 
not using details to using details, the intercorrelations of factors show that 
Space-Visualization has moved away from the others; in particular it has moved 
away from Verbal Comprehension. This is one instance of a very consistent 
occurrence found in many of the pairs. In pairs of suhsamples where some system¬ 
atic approach was used for a test (Pairs 2, 3^ 5^ 6, 7, 9^ 9> It; l6, and 17) 

the correlation between Space-Visualization and Verbal Comprehension always goes 
down, sometimes drastically. In such cases the correlation between Space- 
Visualization and Mathematics also always goes down, except for Pair 15 where 
there was no mathematics factor. This finding suggests that the subjects who 
attempt to solve spatial or other problems by ordinary common sense, perhaps by 
simple inspection until a solution seems to offer itself, succeed pretty much 
according to their general intelligence as measured hy verbal and mathematical 
tests. For those subjects, therefore, the correlation between Space-VisuaJ-izatiou 
and the verbal or mathematics factors is high. On the other hand, the subjects 
who use a system for solving problems have succeeded in developing some special¬ 
ization of their abilities, and so the correlations drop down. 
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Pair 3 , Considcn-G Each Reading Item Alternative . The subjects selected 
ty this factor respond Lo readrng questions only after studying each alternative. 
This behaviorj which can ho cun.-jidcred as a systematic trick for solving the 
test problems, reducoG the loading of Reading on Verbal Comprehensionj that is, 
it decreases the valuo of Reading as a verbad test. 

Fair 11, Studies Relationships in Verbal Analogies Items . This division 
has resulted in no important changes in the factorial pattern. There is a sharp 
decline in the Space-Visualization loading of Punched Holes, but no reason for 
this is apparent. 

Pair 12, Not'js ['pints while Reading in the Reading Test . Mentally or 
actually making notes while reading Ln preparation for answering best questions 
has markedly reduced the loadings of Reading on Verbal Comprehension. Neither 
of the behaviors indicated in Pairs 9 or 12 have much relationship to the score 
on Heading, but botli cause the test to decline in value as a verbal test. 

Pair 13, Art or Music Activities . This factor has a strong effect on the 
loading of Ship Destination on Factor D. Since the meaning of Factor D is not 
very clear, neither is this particular change of loadings. A genereuL rise with 
art or music activibLes in oJjnosL all of the factor intercorrelations is also 
present. Perhaps artistic activities are associated with an integrating effect 
on or a lack of spocialization among the cognitive areas. 

Pair l4, Few Visualization Indications . Amount of apparent visualizing 
while solving spatial problems was associated with no important differences in 
the pattern of factor loadings. There is, however, a sharp decline in the 
correlation of the Reasoning factor, Factor D, with both Verbal Comprehension 
and Mathematics. Again the behavior of Factor D seems to be hard to interpret. 
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Fair 15 , Analytic Approach to Cubes Items . This division hased on the 
Cubes test produced rather dramatic results. The loading of Cubes dropped from 
.52 to .07 on Space-Visualization. Apparently the Icind of analytic behavior 
toward CubeSj which was observed in the interview, completely destroys the 
capacity of that tesb to measure spatial ability. At the same time, the tests 
loading Factor B show that Verbal Comprehension and Mathematics have collapsed 
into one factor. The new Factor C, loading Letter Groups and Number Series, 
seems inductive in nature. It is this new factor that novr carries the principal 
loading of Cubes, suggesting that the analytic behavior of the subjects has 
changed Cubes Troin a test of cpa,cG to a test of induction. This finding seems 
to confirm the results of an earlier study (French, 1957); where most of the 
conventional factors were clear, but where space and induction tests fell on one 
dimension. This happened with West Point Cadets, who may have approached the 
tests with a particularly analytical attitude. 

The verbal-mathematical composite in Pair 15 Aras a surprise. It wa-s not 
lorced by tlie limitation on the number of factors extracted, because Factor E 
has so small a variance tliat it could have provided room for a fifth well-defined 
factor. Tlic collapse of the mathematical and verbal factors is probably related 
to an occurrence which is consistent in all but one of the pairs where a system¬ 
atic approach is used for the solution of problems (unless there is no mathe¬ 
matics factor as occurs for Pairs 3 and 15)- These pairs are Nos. 2, 5; 6, 7; 

8 , 9 , 11, 16 , and I 7 . In all but one of them. Mathematics and Verbal Compre¬ 
hension are more highly correlated for the systematic subsample than they are 
for the non-systematic suhsample. For Pair 15 , Mathematics and Verbal Compre¬ 
hension have simply become correlated in the extreme; they have collapsed into 
one factor. Thus, for the systematic person. Space-Visualization is relatively 




- 22 - 


independent, while the verbal and mathematics factors are relatively close 
together. As discussed in connecbion wiLh Pair 8, the effect on Space- 
Visualization can he regarded as a development of specialized techniques or 
approaches to spatial problems. Ihe systemabic person is also likely to attempt 
the solution of verbal and mathematical problems by the development of special¬ 
ized techniques. Since verbal and mathematics problems are both symbolic in 
naturej the closing together of these factors can^ perhapsj be understood by 
supposing that the systematic subjects can develop symbolic approaches or 
attitudes ^rhich help them jointly in solving both of these kinds of problems. 

Such techniques, being common to the symbolic verbal and mathematics factors, 
draw these t\ro factors together, while they may be quite different from the 
techniques developed for the visible, concrete, non-symbolic spatial problems, 
thus leaving the spatial factor relatively isolated. 

Pair l6, Geometrical Approach to Punched Holes and Surface Development . 

This division of subsamples was based on what seemed to be the application of 
similar methods to the solution of two different kinds of test items, Punched 
Holes, PUN, and Surface Development, SUR. The ratings on these behaviors did 
in fact correlate sufficiently to give rise to factor l6. Nevertheless, the 
loadings for the two toctc are affected in opposite ways. On Space-Visualization 
the loading for SUR rises Crom .76 to .9I; that for PUN drops from .56 to .26. 

The loadings of Spatial Orientation and figure Analysis also drop. Logical 
systems for solving spatial problems were found in Pairs 7 s-nd 15, as well as 
in this one, to decrease factor loadings on Space-Visualization. There is no 
apparent explanation for the rise in the loading of SUR. The factor inter¬ 
correlations for this pair resemble those for Pairs 6 and 7 where factor D 
moved sharply away from Verbal Comprehension. No explanation is attempted 
particularly because of the opposite effect in Pair 17 - 
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Fair 17) Can List Many Hypotheses for Letter Grouping and Maries Items . 

In contrast particularly to Pairs 6^ 7^, and l6, Factor D in this pair moves 
toward Verbal Comprehension rather than away from it. It is of particular 
interest to compare Pair 17 with Pair 6, because both concern hypotheses used 
with Marks, the test with highest loadings on Factor D. The mean test scores 
at the bottom of the tables show that the persons with hypotheses, whether in 
Pair 6 or Pair 17j do better on Marks than do their opposite subsamples. The 
means and the factor loadings at the top of the tables, however, show that the 
people with hypotheses in Pair 6 are not nearly so verbal as those with hypotheses 
in Pair 17- The difference is that Pair 6 concerns using hypotheses, while 
Pair 17 concerns the number of hypotheses which the subjects can list when asked 
to do so. The factor pattern shows that Marks is more of a verbal exercise for 
those who can state their hypotheses verbally and less of a verbal exercise for 
those who are merely observed to use hypotheses. Since Marks measures something 
a little different in each of these two groups of people, Factor E is different 
also and can reasonably be expected to change its intercorrelations with the 
other factors. 

Pair 20, Faster Bejeefcance than Acceptance of Concealed Figures Items . 

Wo important dirferences in the factor patterns occur for this Pair. 

Comparison of Results with Hypotheses 

It is now possible to compare the results of the study with those that 
were expected as listed near the beginning of this report. Each hypothesis will 
he repeated here and then compared to the actual results; 

1. Verbal Analogies will give rise to a reasoning subsample and a knowledge 
subsample. For the reasoning group as compared to the knowledge group. Verbal 
Analogies will load the mathematics reasoning factor higher, and the mathematics 
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reasoning facbor yill have a higher correlation with the verhal factor. 

R esults : Pair 11 comes close to the anticipated, pair of subsamples^ although 
it is not exactly lihr. It. "studying relationships" can he considered to be 
reasoning. The expected difference in loadings did not occur: -.01 to -.02. 

The expected difference in correlations between the mathematics and verbal 
factors was in the expected direction: .63 to - 71 . 

2. Cubesj Gpatial Orientation; and Punched Holes will give rise to a 
spatial sense suhsamplc and a verbal reasoning subsample. For the spatial sense 
group as compiarcd to the verbal reasoning group; the spatial and visualization 
factors will bc’ mor'e oid.liofional to the mathematics reasoning and verbal factors; 
and the group means I'ar the spati.al and visualization tests will be higher. 

Results : Pairs 'fj I'j; and 16 come close to the expected discrimination; although 
it was expected that one pair oJ' suhoamplos would represent this tendency suf¬ 
ficiently well. The .siiacc and visualization factors are; of course, combined 
instead of separate, but this does not interfere with our test of the hypothesis. 
In all three pairs the factor correlations are opposite to those hypothesized. 

The reasoning apiiroacli pulls the spatial-visualization factor away from the 
verbal and mathcinritici: ['actors. With regard to the group means, two out of three 
pairs refute tJio [lypjotlicsis . It seems that spatial ability is better described 
as a specialized type of reasoning than as a kind of mysterious "spatial sense ." 

3- Letter Grouping and Number Series will give rise to a system subsample 
and a trial and error subsample. For the system group there will be an 
induction factor; for the trial and error group there will not. Results : The 
expected suhsamples did not occur. Pairs 3 and 5 concern these tests, hut the 
"system" that was used was, in fact, an intensification of a hypotheses forming 
the trial and error system. 
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il . MQ,Uu3iiiaL'iCD rroblcmc will give rice to an original reasoning; subsample 
and a boxt-book iiic-tlvodi-. [lubiiarnpio. For the original reasoning group there will 
he a malhcinalicc rcacotung factor; for the Lext-hooh methods group there will 
not. Re suite : The expcctsjd. diacrimination was not made in the inter-views; Pair 1 
simply divided the group according to the amount of trouble the subjects seemed 
to be having. 

Tn Gimmiary, the resritts did not match well with the hypotheses. Hypothe¬ 
sis 1 was Gonrinned in :jOine degi-co. Hypothesis 2 was opposite to the results. 
Ilyijotheccs 3 ii-H'-'L l| wen- not found to be testable with the data acquired in this 
study. Failure ol' these iiypotliusec is really not disturbing;, since they were 
stated orLginaiLy only to define the prohlem. There existed no body of theory 
that depended upon tlu;iT' Gonfirmation. 

Summary of Phridingu and ConclusiQn.s 

There ceciris to be extensive evidence here that tests, even simple "pure- 
factor" testr,^ do not measure the same things for all people. The kind of 
behavior most r-i'ad.ily otuicu'ved in coraeone taking these tests was the use of 
some kind of r’f'.'i.S('n('d oi' systematic approach as contrasted to less orderly 
scanning and visuaii'/.ingj witli reliance on common sense. This overall difference 
in problem-solving stylos is the one emphasized by Bloom and Broder (l950, see 
especially Appendixand may be related to Gardner's (1959) Focusing vs. 

Scanning or to Witkin's (1962) Analytic Attitude or Field-Independence. For 
some of the tests^ differences of this kind in the test-taking behavior have 
no relation bo the test's factorial content. For a few tests, the principal 
loading was strengthened. Most often, however, the use of a system in solving 
a test reduced the usual factor loading of that test, sometimes drastically. 

This happened more regularly for spatial or visualization tests than for 
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reasoning or vertai testa. These rindines are understandable in terms of the 
view that teats arc efforts on the part of the test constructor to set up 
standard tasks for the subject. In some cases the systematic approach to a 
test may eliminate some random behavior, thereby increasing reliability and 
increasing the expected test loadings. More often, however, the system enables 
the student to respond to the test items after undergoing a task partly or 
entirely different from the one that the test constructor had in mind. In such 
cases the expected factor loadings of the test decline or vanish altogether. 

Some rather general findings vjere also observed with regard to the inter- 
correlations of the factors, As compared to the factor correlations for 
subjects who did not use systematic problem-solving methods, the correlations 
for the more systematic subjects showed the Space-Visualization factor to be 
further off by itself and Verbal Comprehension and Mathematics to be closer 
together. An explanation for this was attempted by suggesting that the more 
reasoned problem-solving style permitted the discovery through a reasoning 
process of specialized techniques of a spatial nature, while the some reasoning 
process directed the subjects toward a common means for solving symbolic 
problems with either verbal or mathematical conbent. 

Another way of thinking about changes in what tests measure is to consider 
as "moderator variables" the dichotomies that were used to divide the total 
sample into subsomples. Moderator variables are variables whose values are 
associated with different amounts of correlation between two other variablesj 
thus they seem to moderate or regulate the correlation between the other 
variables (Saunders, I 956 ), Systematizing is a variable that was found to be 
associated with lower correlations between the test being systematized and 
other tests ordinarily loading the same factor. This caused a decrease in the 




loadings of the test in question on that factor. Going beyond the test itself, 
the finding ws that systematizing on any test las associated with lower corre¬ 
lations between spatial and other hinds of tests and hi^er correlations between 
verbal and mathematical tests. These changes in correlations resulted in 
corresponding changes in correlations among the factors. The above-mentioned 
apeculations about the specialization of spatial ability and the use of symbolic 
reasoning to solve both verbal and mathematical problems now apply as explana¬ 
tions of the action of systematizing as a moderator variable. The logical 
sequence is this; Systemtizing is a tendency which leads a person to use 
specialized or symbolic thought processes; this changes what the tests measure 
and, consequently, affects the correlations between the tests, 
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Paxr 1 - T' indB Lgcb vg . More Trouble with Mathematics Problems 


Subjects who vcro inarhed. pLuc on 3 or more oC bhe Tollowing: 

PoadG problciiiG only once 
Eoos not jiiontion trouble 
Has no trouble decidinc on method 
Wien ashed, i-eporta no trouble with method 
■When ashed, reports no trouble understanding the problem 

Comment: The above variables have loadings on Factor 1 ranging from .32 to .52. 

The "college" and test variables with higher loadings (below) were not 
used for the division of subsamples, because to do so would spuriously 
curtail the variance of the test variables in the subsample factorizations. 

Loadings on Factor 1 : COLLKGF .67, SUR - 72 , VOC - 4 ^ 1 , NIJM .5I, MAT .76, MAE . 48 , 

I,I',T .60 


2 . 

3. 

5 - 

11 . 

12 . 
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CON .46 
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Pfur P - Uric'S Rule in Solving Cards Items 


Subjecbs vlio were inartod iiliic on 3 ob more ol tlie following; 

L|8. Analyoeo stum of Cards items first 

49. Analyzes stem and alternatives before sol-vlng 

51, Uses gcoinctrical terms 

. Accepts items by using a rule 
55. Wlien asbedj reports starting with, a rule 

Loadings on Factor 2 : COLLEGE . 12 , SUR . 12 , VOC .07, MJM .05, MAT . 12 , MM . 10 , 

LEI . 1 ^, CAR -.08 


Does not use rvilc, N = IO9 


A 

SUR .76 
GAR .5^ 
COW .48 
FIG .39 
CUB .38 
PUN .38 
SPA .37 


B 

VOC .72 
REA .67 
VER .66 
MAT .25 
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Pair 3 - Emphasizes Relationships in Number Series Items 


Subjects who were marked plus on 3 or more ol the following: 


86. Starts number series items by observing relationships 
88. Tries high numbei- of relationships 

90 . Does not try patterns that skip or do not account for all numbers 
93. Tries multiplying and dividing rather than only adding and subtracting 
9l^-. vnien asked, reports trying relationships before scanning 


Comment: 


All of these have near zero loadings on Pactor 1 except Variables 88 
and 93 , which have loadings around . 20 . These two variables have 
moderate correlations with Mathematics, Number Series, Vocabulary, 
and Reading tests, and College vs. High School. 


Loadings on Factor 3 ; 


COLLEGE ,15, SUR -.05, VOG .20, NUM .36, MAT .26, MAR -.02, 
LEf .02 


Few relationship:: , N = 

94 

Many relationships, N = 83 

A 

B 

C 

D 

A 

B 

C 

D 

SUR .71 

REA 

.71 NUM .58 

MA]^ .49 

SUR .84 

VOC 

.76 NUM .63 

MAR .58 

CAR .51 

VOC 

.6k MAT .48 

CON .26 

CAR .72 

VER 

.56 LET .34 

SHI .34 

PUN .38 

VER 

.60 SPA -.24 

SPA .24 

CON .55 

REA 

.56 MAT .29 

(NUM-.03) 

CUB .37 

SPA 

.32 CUB-.23 

SHI .23 

CUB .55 

MAT 

.25 


FIG .32 

(NUM- 

.13) LET .21 

LET .23 

PUN .52 

CUB 

.20 E 


CON .32 



(NUM .09) 

FIG .49 

(NUM- 

.10) LET .38 


SPA .23 


E 


SPA .49 


CON .38 


(NUM-.15) 


LET .l |0 


LEI .21 


CUB .24 




PUN -.24 


(NUM-.06) 


SPA -.21 




(NUM . 04 ) 




(NUM .01) 








ABC 




A B G_ 







B 

■49 



B 

.34 



C 

.60 .68 



C 

.47 .64 



D 

.73 -53 -6^ 



D 

.55 .64 .71 








M. S.D. 




_S -D- 











SUR 

29.7 13-7 



SUR 

26.5 L 2.5 











VOC 

24.3 7-2 



VOC 

20.7 8.6 











NUM 

26.4 3-7 



NUM 

23.1 4.5 











MAR 

9.6 3-9 



MAH 

9-5 3-8 











LET 

15.6 4.0 



LET 

i 4.5 3.7 











MAT 

13.1 2.6 



MAT 

11.5 3.3 
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Pair ^1- - Likea Verbal SubjecLs vs. Likes Science 


q h ects who dlti nob check science as their favorite subject or major. 
vLiable 10?; Science as favorite subject or major, has a loading of -.05 on 

Factor 4 . 
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Pair 5 - UsGE HypoLheaes for Lebber Groups Items 


Subjects who were marl'-ed plus ou 3 or more of the following- 

25. Brings hypotlu'ses to letber groups items rather than scans 

26, Spends little bimo scanning 
28. Applies hypotheses 

31, When asked j reports starting with ideas rather than scanning 

32. When asked; reports spending more time on ideas than on scanning 

Loadings on Factor 5 : COLLEGE . 04 , SUE -. 03 , VOC . 09 , MJM -. 02 , MAT . 20 , 

MAR -.30, LKf -.27 




Scans, 

N 

= 110 




Use 

s hypotheses 

, N = 

67 



4 


B 



c 

D 


A 


B 


c 


D 


SUR 

.85 

VOC 

.72 


NUM . 61 | 

MAR 

.63 

SUR 

.61 

VER 

.62 

NUM 

. 5 ^ 

MAR 

■ 43 

GIB 

.59 

VE13 

.64 


MAT .36 

cm 

.33 

CAR 

.60 

REA 

■ 57 

MAT 

■ 52 

PUN 

.27 

CAR 

■57 

REA 

.61i 


cim-.jo 

(let 

. 13 ) 

CON 

.^13 

VOC 

.56 

LET 

.32 

PIG 

.24 

FIG 

.ii7 

MAT 

.28 


LIT .26 



CPA 

.40 

(LET 

. 13 ) 



SHI 

.22 

CON 

.44 

Sill 

.2L 





PUN 

.30 



E 


(LET- 

■ iM 

PUN 

.k2 

(LET 

.01) 


E 



CUB 

.23 



LET 

.54 



SPA 

■35 




LET . 3 H 



PIG 

.21 



CUB 

■33 



(let 

•13) 




PUN-.21 



(LET 

■ 13 ) 



COW 

■23 








SPA-. 21 







VER- 

.21 






A 


B C 






A 

B 

C 





fl 

'15 







fl 

39 







C 

57 


65 





C 

52 

•7^1 






D 

Gl 

■ 

58 .61 





D 

.76 

■ 57 

.69 






M 


S.D. 






M. 

S.D. 





SUR 

28 

3 

13.3 





SUR 

27. 

4 12.8 





VOC 

22 

8 

T-9 





VOC 

21. 

7 

8.6 





NUM 

24 

7 

4.3 





NUM 

24. 

5 

4-7 





MAR 

9 

8 

li.O 





MAR 

9 . 

1 

3.6 





LET 

15 

3 

3.0 





LEI 

l 4 . 

5 

4.0 





MAT 

12 

.2 

3.0 





MAT 

12. 

3 

3-3 
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Pair 6 - Uses Hypotheses for Marks Items 


Subjects vho were marked plus on 3 or more of the following: 

96. Brings hypotheses to Marks items rather than scans 

97. Spends little time scanning 
99. Applies hypotheses 

102 . When asked, reports starting with ideas rather than scanning 

103. When asked, reports spending more time on ideas than on scanning 


Loadings 

on 'Factor 6; COLLEGE - 
MAE -. 00 , 

.16, 

LET 

SUE . 20 , VOC -. 29 , 

-■15 

NUM 

-. 24 , MAT - 

.30, 

Scans, N = 81 i- 

Uses 

hypotheses, N = 

93 

A 

B C 


D 

A 

B 

C 

D 

SUE .81 

VI® 

.67 NUM ,67 

MAR 

.62 

SUE .77 

VOC 

62 NUM 

60 MAR . 52 

CAR .55 

VOC 

.62 MAT .37 

SHI 

.42 

CAR .56 

REA 

62 MAT 

39 CON .20 

CUB .52 

REA 

.54 LET .35 

CON 

.20 

SPA 55 

VER 

57 SHI 

29 

PUH .50 

SPA 

.25 CUB-.25 



FIG .48 

MAT 

20 LET 

21 

CON .41 

MAT 

.23 (MAli .02) 



CON .47 

(mar-.02) (MAR 

.02) 

FIG .39 

(mar 

-.11) 



CUB .43 




SPA .32 


E 



PUN .37 


1 


(MAE-.11) 


MAT -.33 



SHI .26 


LET 

.49 



LET .31 



(MAR-.12) 


CUB 

-34 



CUB .25 





(mar- 

.00) 



(MAU . 04 ) 









ABC 





A B 

C 


B 

43 




B 

.41 



C 

55 -63 




C 

.46 .72 



D 

56 .66 .57 




D 

.66 .37 

-55 








M. 

S.D. 



M. S.D. 








SUE 

28.4 13.3 




SUE 

27-6 

13.0 







VOC 

21.8 

8.1 


VOC 

23.0 8.2 













NUM 

24.3 

4.6 


WUM 

25.0 4.3 









9.1 3-8 




MAR 

9-9 

3-9 


MAR 













LET 

14.7 

3-4 


LET 

15.4 4.2 













MAT 

12.1 

3-3 


MAT 

12.5 2.8 
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Pair 7 - UHC[j Kuauoninc for Spatial Orientation Items 


Subjects vhu were iiifu-ked plus on -) or more oP the rollowing: 

78. Has a iiiochanLc’ril rule for rcr.olvinc tilt of boab 

79. Uses ('oomoLr Lcal. term!. 

00. Usolj lev v.i. suai I'/a t Lon intlrcationo 

85'. V/licn asked, roiKU'ts he uses rule for resolving tilt 
84 . When asked, reports he uses geometry 

Tnadines on Factor 7: COLIJUGF - . 15 , SUR . 04 , VOC . 10 , NUM . 00 , MAT .07, MAR - .00, 
^ ^ LET . 06 , Sl'A .05 
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Pair 8 - Uijoa DeLaila of Figures in Concealed Figures Items 


Sutjects who wore iiKirkod plus on 2 or more of the following: 

Yl. Uses a fjpociJ'ic characteristic for deciding an item does not contain 
figure 

72. Accepts prcncncie of figure in item part by part 

77. When asked, reports accepting presence of figure part hy part 

Loadings on Factor 81 COIJUGE . 13 , SUR -. 20 , VOC -. 01 , MM . 01 , MAT -. 12 , 

MAR .16, LET .06, CON -.05 



Does not 

use details, N = fll 


Uses 

details, W = 96 


A 


B 

G D 

A 

E 

C 

D 

SUR 

.73 

VER 

.(;8 NUM .65 MAR .64 

SUR .80 

VOC 

.71 MAT .54 

MAR .38 

CAR 


VOC 

.03 MAT ,36 2111 .31 

CAR .66 

REA 

.64 NUM .48 

SHI .32 

CON 

.40 

WA 

.58 IMT .35 (CON .06) 

CUB .58 

VER 

.55 LET .21 

FIG ,31 

FIG 

.39 

MAT 

28 CUB-.23 

PUN .46 

(CON 

.05) (CON-.06) 

CUB -.20 

PUN 

.59 

(con 

. 09 ) (CON , 04 ) 

CON .43 



(CON .19) 

CUB 

.38 



FIG .34 


E 


SPA 

.37 


E 

SPA .34 


LET .51 





MAT . 3 i 

LET .23 


CUB ,50 





LET-.31 



FIG .28 





PUN .21 



(CON .17) 





(CON .06) 








ABC 



ABC 




B 

.39 


B 

.28 




C 

. 66 .69 


C 

.42 .67 




D 

.73 .64 .64 


D 

.59 -55 -71 








M, J. h. 





M. S.D. 







SUR 

30.7 14.3 


SUR 

25.6 11.6 




VOC 

21.6 8.5 


VOC 

23.0 7-9 




NUM 

24.3 ^-5 


HUM 

24.9 4.4 




MAR 

9.2 4.1 


MAR 

9-9 3-5 







LET 

15.4 3-9 




LET 

14.5 3-7 










mat 

12.3 2.9 




MAT 

12.3 5-3 







CON 

79.1 92.2 


CON 

69.6 19.2 
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Pair 9 ~ CoUi.K-leru K'lch Reo/liny Item Alternative 


Sutjecte vho were cheel:i‘rl ar; Leiit,LLti.vcly rojectinff or accepting each alternative 
oT the Reading 'I'cid, il.uitu. lud'ore rcachLng a decision. 


Loadings on Fac Lor 9 : 


CORLKaR .O'lj RUR -.10, VOC -.02, NUM .11, MAT -.01, 
MAR -.17 ; let . 06, REA .08 


Does 

not consider each, N - 

03 

Considers each alternative. 

II 

A 

B 

C 

D 

A 

B C 

D 

SUR .77 

REA 

.73 NUM .66 

MAR .58 

SUR .80 

VOC .65 NUM ,54 

MAE .49 

CUB .L8 

VOC 

.7R MAvT .46 

SHI .29 

CAR .67 

VER .50 MAT .30 

SHI .36 

CAE .L5 

VER 

.63 LEP .LM 

(REA .03) 

CUB .43 

REA .42 LET .27 

CON .24 

CON .4-3 

DPA 

.J7 CUB-.UO 


SPA .41 

(REA .04) 

PUN .23 

FIG .^lO 

MAT 

.23 (REA-.ll.) 


PUN .40 


SPA .23 

PUN .37 

CUB 

.UO 


FIG .37 

E 

FIG .20 

SPA .31 


E 


CON .35 

LET .59 

(REA .01) 

(REA .03) 


CUB .36 


(REA .04) 

FIG .24 




l'UN-.U3 



CUB .23 




LET .22 



CON .20 




(REA-.04) 



(REA .03) 




ABC 



ABC 



D 

.47 



B .41 



C 

.67 .60 



c .33 .00 



D 

.73 .!j 7 -67 



D .50 .63 .63 







M. S.D. 




M. .S. D . 






SUR 

28.2 13.9 



SUR 27.8 12.4 



VOC 

23.2 0.5 



VOC 21.7 7-9 



NUM 

24.9 4.3 



NUM 24.4 4.6 



MAE 

9.0 3.6 



MAR 9.4 3.9 







let i 4.9 4.0 



LET 

15.1 3.7 










mat 12.2 3.0 



MAT 

12.3 3.2 






REA 

10.1 3.6 



REA 9-9 3-3 




- 32 - 


Pair 11 - Studies Relationships in Verbal Analogies Items 


Students who were inarkc'd x>lus on P or more of the rollowing: 

4^. Syutcmaticaily evaLuabos aiternativeo in Verbal Analogies items 

46. When aBkedj I'opoj'ts appiying relationship of stem to each alternative 
rather than scanning the alternatives to find one that looks right 

47 . Whon ar.kcdj reports Gpending more time studying relationships than 
scanninf:; 

Comment: Coi’relations witli College vs. High School and the test scores including 

Verbal AnalQgia.s are generally low and positive for Variable 44, mixed 
for 46, and cubctantially negative for 4-7- 


Loadings on Factor 11: COLI.KGE -.03, SUE -.13, VOC .03, HUM .21, MAT .00, MAR -. 06 , 

LIT . 16 , VER -.02 






- Nijl.ofi Poiul.:; v;hi 1 l* Rc;ading in the Reading Test 


subjects who W(>)-o iil.ui- un 1. ni- l.oUi oJ' the rollowiriE: 

6i. Under inn'ij or tiikon noL(;:i whl3t; n'tiilirig the paragraph 
67 ' Wicn ai.lu’dj ruportn iiuniLLilly (or otherwise )j rioting particular points 
wilt in ruadiiig 

rnirrments' Variable 6L currelaben .'jQ with College va. High School, -39 with 

VocLihuiory, .22 vnth Rjathomabica, low positive with most other tests, 
and" .11 with Reading. Variable 67 correlates low negative with 
College vs. Illgb School and the test scores, -.23 with Reading. 
Variables 6i and 67 correlate with each other .59- 


Loadings on Ractor 12 : 


COLLEGR . 24 , SUR - .06, VOC .09, RUM - . 00 , MAT .11 
MAR .19, let -.13, REA -.09 


Reads for 

general 

I riii)ro.si! i on. 

N -= 9O 

A 

B 

C 

D 

SUR .74 

VER . 9 Y 

NUM .52 

MAR .94 

GUB .51 

VOC .57 

MAT .111 

Bill ,29 

CAR .50 

REA .>-17 

(REA-.Oj) 

aUR -.21 

PUR .47 



(REA .08 

CON .42 


E 


PIG .42 


LICT . 1+7 


SPA .kO 


(REA- .Oil ) 


(REA .03) 







Notes 

points 

, N = 

79 



A 


B 


C 


D 


OUli 

CO 

VOC 

■ 75 

NUM 

.69 

MAR 

■ 49 

CAR 

,66 

REA 

.74 

LET 

.44 

SHI 

.38 

CON 

.45 

VER 

.62 

MAT 

1—1 

FIG 

.30 

RUN 

.38 

CUB 

.31 

SPA- 

.22 

SPA 

.29 

BPA 

.36 

MAT 

.27 

(REA- 

.05) 

(REA- 

. 04 ) 

CUB 

.35 







FIG 

.34 





E 

.24 

(KEA- 

.01) 



CUB 

-32 

MAT- 




FTG 

.27 

(REA 

.11) 





LET 

.27 




ABC 


B 

. 52 



C 

■59 

■ 77 


D 

.72 

.59 

.63 


M. 


S.D. 

SUR 

28. 

7 

13.6 

VOC 

22 . 

8 

8.0 

NUM 

OJ 

9 

4.0 

MAE 

9, 

.3 

3^6 

LET 

15 

.1 

3^9 

MAT 

12 

, 4 

3.0 

REA 

10 

.2 

3^2 



A B 

C 




B 

■ 32 


C 

.44 .60 


B 

.55 ^82 

.69 


M. 

S.D. 

SUR 

27.1 

12.2 

VOC 

21.9 

8.4 

NUM 

24.3 

4.9 

MAR 

9-9 

3.8 

LET 

14.9 

3-8 

MAT 

12.1 

3-2 

REA 

9.8 

3.7 
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Pair ]3 - Art or Munjc Activities 


Subjects who listed ac l,i vl t Ins on tin' (luostionnaire in one or both of the 
following catcgoi’n;::; 

113, Ai't or niui-ilc fji'.t, i vi Li or. at liome 
116. Art or muoLc uclivitLcis in school 

Tn^dinas on Factor 13= COLLEGE .11, EUR -.06, VOC .02, NUM .I8, MAT .14, MAE -.02, 

^ LEI’ .oy, mi .01 


Neither 

of these, N = IO3 


Art 

or masic activities, N 

= 72 

A 

B 

C 

D 

A 

B 

C 

D 

SUE .78 

YW 

.72 NUi.l .73 

MAR .94 

SUR .80 

VOC 

.62 NUM .98 

SHI .51 

CAR .59 

miA 

,70 MAT .42 

(UHL .L 9 ) 

CUB .62 

VER 

.50 MAT .28 

MAR .48 

CON .46 

VER 

.68 LET .23 


CAR .51 

REA 

,45 LET .27 

CON .21 

PUN .39 

GPA 

.29 (run .1.:!) 


SPA .50 

(SHI 

.08) (SHI-.06) 


FIG .39 

MAT 

.28 


PUN .45 




CUB .38 

CUB 

.26 E 


PIG .39 


E 


SPA .29 

Sill 

,23 CUB .4I1 


CON .39 


LET .43 


(SHI .06) 


LET .43 


(SHI .06) 


CON .33 




(SHI . 02 ) 




(SHI .02) 








ABC 




A_B_L 







D 

.36 



B 

.56 




, 



c 

.62 .77 



C 

.*ju .63 







D 

.67 .91 ■98 



D 

.66 .67 .70 








M. S.D. 




M. S.D. 




mmm 







SUR 

28.3 13-6 



SUR 

27.8 12.8 







VOC 

21.6 8,5 



VOC 

23.5 7.6 



NUM 

24.1 4.5 



NUM 

25.5 ^-2 



MAR 

9.4 3.6 



MAE 

9.7 ‘+■1 



LET 

i 4.6 3-9 



LET 

19.6 3.7 







MAT 

12.7 3.0 



MAT 

12.0 3-1 







BHI 

39.3 7.2 


- 

SHI 

39.8 8.9 

— 




- K* ■\f V i t;u:i-Lj.:’,rj.l:ion Indications 


subjects who woro .iiurt-a idnr, on T' or iiiuro oL' Iho i’ollowins: 


l4. 

36 . 


Comment: 


1\;W vJi.unhiv 
]'\;w V i i.iir*,! J : 
Vow V 1 1 j ; 


'itiwa Uuiionliono itiado an r.olvint; Cuhcs items 

iiidLfutiorifi inado in aolvine Surface Development items 
,;!.tioii uidieationu wade in aolving Cards items 


TntGrcorr.-Lntioun o!' these 3 variables range from .2? -52; those with 

Few Vaeualiuatioii 1 ndieatLons for Punched Holes and Spatial Orientation 
po'silLvo hx-.t hoiou .2!;. For the 2 latter variables, respectively^ 


are 


tte 1-dOtor IL «ra -iS and -22 a. compared with loadlnga of 

.37^ .87, and .‘^8, respectively, for Variables 14, 3°; and 52- 


Loadings on Factor 


l 4 ; 


CniJJlGF. .10, SDR .06, VOC .08, 
i.Ki' -.01, CUB -.00, CAR .l4 


lJUM . 02 , MAT -. 02 , MAR . 09 , 
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Paax' 15 - Analytic Approach to Cubes Items 


Subjects who were imiiiced plus on 2 or more of the following; 

15. Gcoinetrical. terms used in solving Cubes items 

ll| . Few visualisation indications made in solving Cubes items 

16. When asltedj reports mentally rotating the cube on two separate axes 


Loadings 

on Factor 

15 

: COLLEGE 

.03, SUR - 

14 , VOC - 

00 , NUM . 02 , 

MAT .13, 








MAR -.01 

, LET 

.15, 

CUB - 

.03 








Visual 

or 

otherj N = 86 





Analytic, 

N = 91 



A 


B 



C 

D 


A 


B 

C 

D 


SUR 

.76 

VOC 

.67 


NUM .76 

MAR 

.55 

SUR 

.64 

REA 

.75 

LET .52 

MAR 

.49 

CAE 

.60 

VER 

.63 


MAT .43 

SHI 

.24 

CAR 

.46 

VOC 

.75 

NUM .29 

SHI 

.32 

CUB 

.52 

REA 

.52 


UTT .22 

SPA 

.23 

PUN 

.35 

VER 

.66 

CUB .24 

CON 

.25 

FIG 

.51 

MAT 

.20 


CUB -.20 

(CUB 

.01) 

SPA 

.35 

MAT 

.60 

VER -.24 

(CUB- 

.02) 

CON 

.50 

(CUB 

.11) 





CON 

.24 

NUM 

.44 




PUN 

.37 




E 



LET- 

.22 

(CUB 

. 07 ) 

E 



SPA 

.28 




LET .40 



(CUB 

.07) 



SPA .35 



MAT 

.20 




(CUB .15) 







(CUB .17) 






A 


B C 






A 

B 0 





B 

63 







B 

.30 






C 

46 


54 





C 

.79 

58 





D 

67 


V .59 





D 

.61 

60 .73 






M 


3 .D. 






M. 

S.Ii. 





SUR 

29 

0 

14.1 





SUR 

27,0 

12.1 





VOC 

22 

0 

8.5 





VOC 

22.7 

7.9 





MM 

24 

5 

4-.5 





NUM 

24.8 

4.4 





MAR 

9 

1 

3-7 





MAR 

10.0 

3.9 





LET 

14 

6 

3.8 





LET 

15.3 

3.9 





MAT 

12 

1 

5.2 





MAT 

12.4 

2.9 





CUB 

14 

3 

8.5 





CUB 

12.0 

7.6 







Pair l6 - Geometrical Approach to Punched Holes and Surface Development 


Subjects who were marhed plus on P or more oP the following- 

19. Vulunteerc that he has a nystem for Punched Holes items 

21'. Few visualiKution indications made in solving Punched Holes items 

3 Y • Geometrical rcason,i-nG used In solving Suriace Development items 

Toadinps on Facbor 16; COLLEGE . 02 , StIR -.03, VOC -. 04 , HUM -.09, MAT -. 08 , MAE -.06, 

LET -. 24 , PUH .11 


A 

SUR -76 
CAR .64 
PUN .56 
SPA .52 
FIG .51 


Visual or other, N = 91 


Geometric, H = 86 


HUM .69 
MAT -44 


SUR .91 
CAR .52 


VOC .70 HUM .69 mar ,47 SUR .91 

REA . 62 MAT - 44 SHI . 42 CAR . 52 

VER .57 LET .22 (PUN .Ol) CUB .47 

mat . 21 ^ (PUN .07) (SUE-.08) CON -^iO 
SPA .22 (SUI^-. 09 ) -27 


CON .50 CUB .21 
CUB .46 (PUN-.00) 


(SUR .06) LEI .45 
(PUN-.07) 
(SUR-.06) 


FIG .27 
PUN .26 
SPA .20 


B C - 1 

REA .58 NUM .55 mar .58 

VOC .56 MAT .30 FIG .33 

VER .51 LET .30 PUN .32 

mat .20 SHI .26 SPA .28 

(pun .12) (pun-. 08) SHI .22 
(SUR .09) (SUR-.16) SUR-.20 

E 

LET .43 
CON .23 
CUB .24 

(PUN-. 06) 

(SUE- . 04 ) 


B 

,48 


C 

.53 

.61 

D 

.60 

.70 


M. 

S -D. 

SUE 

25.5 

i 4 .i 

VOC 

21.6 

8,4 

NUM 

24,1 

4.6 

MAE 

8.8 

3.9 

LET 

l 4.6 

4.0 

MAT 

11.7 

3.4 

PUN 

42.4 

18.6 



M. 


S.D. 

SUE 

30. 

6 

11.4 

VOC 

23 - 

,2 

7-9 

NUM 

25. 

,2 

4.2 

MAE 

10 

.4 

3.6 

LET 

15 

.4 

3-6 

MAT 

12 

.9 

2.6 

PUN 

53 

.4 

12.6 
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Pair 17 - Can L1 ub Many Ilypothenec Tor Letter Grouping and Marks Items 


Subjects wtio vcro ma.rkod plus on 1 or Lotli ol the followlnE: 

33. Wlion a:ila;dj wuo able to lint many hypotheses on Letter Groups items 
104 . When anlicrl;, able to list many hypotheses on Marks Items 

Comment’ Variable 33 near zero or low negative correlations with College va. 

H.S. and the teat scores. Its correlations are particularly negative 
for Letter Groups and Marks test scores. Variable 104 has moderate 
positive correlations with College vs. H.S. and all test scores. They 
correlate .45 with each other. Variable 104 has low correlations with 
the Marks tost items listed for Pair 6. 

Loadings on Factor I?: COLLEGE . 03 ;, SUR . 00 ^ VOC . 22 , NUM . 21 , MAT . 00 , MAE . 12 , 

LFT ,16 
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Pair 20 - l'’af.L('v Hrji'ctniiL-f' bhaii Acceptance oP Concealed Figures Items 


Sutijecbs idio ^fc t'c marhiut 71 In:; on ± or both of blio fallowing: 

70. nrcidfi!'- on J l.oin doc:; nob coiiLaLn a figure faster than that it does 
cuntiO,lii a J 9 ('U'i; 

76. When a;;,l:o(i, roporLs bclinvior invariable 70 

Loadings on Factor 20 - COLI.FOR . 13 , Sm^-. 19 , VOG . 09 , MM - 33 , MAT .26, MAR . 11 , 

Ll','L'-.i 3 , CON-.07 



Faster 

acceRt;incc , N = 

53 

Faster rejectance, N = 124 

A 

B 


C 

D 

A 

B 

C 

D 




— 

, 






SUR .75 

VER 

.62 

NUM .'jO 

MAR .63 

SUR .76 

VOC 

.68 

NUM .68 

MAR .49 

CAR .60 

REA 

.61 

HAT .liR 

SIIL .36 

CAR .50 

REA 

.64 

MAT .37 

SHI .31 

FIG .57 

VOG 

.61 

cuji- .29 

CUB .27 

CUB .44 

VER 

■ 59 

LET .28 

FIG .28 

SPA ,53 

(CON 

.10) 

(CON-, 04 ) 

(CON .11) 

CON .33 

MAT 

.27 

(CON-.05) 

SUR -.20 

CUB .53 





PUN .33 

(CON-.02) 


PUN .20 

CON .48 



E 


SPA .32 



E 

(CON .19) 

PUN .47 



TiET .40 


FIG .22 



LET .48 





CAR .26 





CUB .38 





lJIIT -,22 





(CON .15) 





CUD -.20 










(con .19) 









A 

B 0 




A 

B C 



U 





B 

36 




C 

.6u 

7^1 



C 

50 . 

64 



D 

.48 . 

,48 .94 



D 

■ 75 ■ 

58 .66 









M. 

S.D. 




M. 

S .D. 








SUR 

28.0 

13-0 



SUR 

27.6 

13.2 



VOC 

21.4 

8.9 



VOC 

22.8 

7-9 



NUM 

23-7 

4.8 



NUM 

25.0 

4.2 



MAR 

8.5 

4.2 



MAR 

10.0 

3.6 



LET 

14.7 

3.8 



LE 1 ‘ 

15.1 

3-9 








mat 

12.3 

3.1 



MAT 

12.2 

3-0 













CON 

71.0 

20.3 



CON 

70.2 

21.4 


J - 








-'r'- 
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Footnotes 


1 

Grateful acknowledgment is made to Mr. Leighton A. Price, who skillfully 
and conscientioucly conducted over 200 interviews, scheduled the testing, and 
helped in asoemhling the data used in this research. 

2 

All coraputationn were prograMned and carried out by Br. David R. Saunders. 

''^Specifically, there is almosh always a sharp drop after the fifth 
eigenvalue. For the whole group, the first seven and last eigenvalues were 
as follows: CX'), l.f)0, . 69 , . 99 , .20, . 11 , .09 ... -.15. Out of the 
subsamplc facborixuLjons, only in the case of Pair 4-positive (liked verbal 
subjects) and Pair IP-positive (notes points while reading) was the drop in 
eigenvalue greater bul.ween the sixth and seventh factor than between the fifth 
and sixth. Compared to the last eigenvalue, the fifth was always higher and 
the sixth was lower in 20 out of 3^ cases, Only in the case of Pair 12- 
positive was the sixth eigenvalue more than a quarter of the distance from 
the last ono up to iihc fifth. 

4 

Again the computatioM were devised, programmed, and carried out by 


Dr. David R. Gaunders. 





Interviev Test Items 




-Al- 


MA.TH PROBLEMS 


Directions ; The 
which you did In 
look at the five 
spondinf^ to the 


5 problems given below are similar to the ones 
the MATH PROBLEMS test. Work each problem. Then 
auggeated answers and circle the letter corre- 
correct answer. 


1. Brovm and Smith each placed a ifilOjOOO 
order with a certain company. Brown 
was granted a discount of ?.0^ and 
Smith was grazrted two Duccceolve 
dlecounta of 10^ each. How much more 
did Smith pay than Brown? 

A Ho more 
B |100 
C ^400 
D $1000 
E $1900 

2. If eight persons each write an odd 
number less than 10 on a blackboard 
and no one number is written by more 
than three persons, wtiat Is the 
Bmallest possible s\un of those numbers? 

A 16 

B 17 
C 22 
D 50 
E 54 

5- A child's rectangular block measures 
8 inches by 4 inches by 2 inches. What 
is the smallest number of these blocks 
needed to build a perfect cube? 

A 4 
B 8 
C 16 
D 32 
E 64 


4. If Dick, who is cycling at 9 mph, 
starts 1 hour after Tom, who is ■ 
walking at 4 mph, how many milee must 
he ride to catch up with Tom? 

A 5 1/5 

B 5 T/9 

c 7 1/5 

D 8 1/2 

E 16 1/3 

5 . How much will it cost to erect a fence 
around a rectangular lot 40 feet long 
and 25 feet wide with fencing that 
costs 3® cents a foot? 

A $10 
B $15 
c $19-50 
D $30 
E $39 
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CUBES 


Directions ; The 4 sets of drawlngB below are similar to the ones 
you did in-the CUBES teat. For each set put a plus (+) in the 
small square at the right if both drawings represent the same cube. 
Put a minus (“) in the square if they represent different cubes. 
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PUNCHED HOLES 


Directions : The 2 sets of diagrams below are similar to the ones that you 
did in the PUNCIJED HOLES test. The diagrams represent a sheet of paper that 
is folded a number of times. Holes have been punched in the right hand 
diagram. Show by drawing small circles in the left square where the holes 
will be when the paper is unfolded. 


If you think it will be helpful you may draw circles in the other 
figuresj but do not do so if it will merely waste time. 







LETTER GROUPING 


mrections : The 5 rove of grouped letters given helov are slinllar to the ones 
jj,a i n the LETTER GROUPING teat. In each ro¥, three of the groups of 
letters are alike In some way. Circle the one that Is different. 


NNOP 

QRSS 

TTUV 

WWXY 

PXAM 

SPCD 

DXMF 

SAMY 

MEAN 

ODGP 

QFER 

SGHT 

MLLM 

DCCD 

RSSR 

HGGH 

STTT 

RRRS 

SSST 

QRRR 
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SURFACE DEVELOPMENT 


Dlrectionc: The problem below is similar to the ones you did in 
the SURFACE DEVELOMNT test. The drawing on the left is a flat 
piece which can be folded on the dotted lines to form the solid 
figure on this right. If this is done, where will the edges and 
side marked by the numbers be in the solid figure? Remember that 
aide X is alwayo marked in both drawings. 






VERBAL AWAI.OGIES 


Directions: The 4- items given belov are similar to the ones vhich 
you did in the VERBAL ANALOGIES test. For each item circle, the 
number of the pair of vords vhich is related in the same vay as the 
words of the original pair are related. 


1. Small :Ma(;5nlJ’y;; 

1 right;rectify 

2 loud;amplify 

5 indignant:pacify 
k wise;stupefy 
5 obscure:clarify 

2 . Eulogy;Hear:: 

1 elegy:flute 

2 monument; see 
5 trilogy:three 

4 shroud:mystery 

5 eyeglasses:face 


5. Systematic:Procedure:: 

1 logical:argument 

2 timely:report 

5 intense:feeling 

4 practical:decision 

5 wary;opposition 

4. Worldly:Body:; 

1 valuable:gold 

2 celestial‘.Mars 
5 ethereal;spirit 

4 wordy:reminiscence 

5 round:solid 




CABDS 


Directions : The 2 rows of cards shown helow are similar to the 
ones which you did in the CARDS test. In each row, mark the space 
below every card that is like the first card in the row. 














flEADIKG 


DLri'c I, i nil !.: Tti'* tif Lcf'Ll on I'.lven be.Low iti similar to the ones which 
yon ri'iul in thn HMA-lJlNtJ Following the selection are several 

iiiuiLlpli' t'luiif'ii U.i'Kii, concernlnf; it. 

Ri-ad the f;<‘bMition carefully firstj and then answer the 
multiple clJuLui' quiuilionr:. Circle the number corresponding to the 
nnawiir you si'lui'.t. 


IlTkiwinn furcpi'ully expresses his misguided opin¬ 
ion rii' tii.i ugllnenr. of family life in a picture which 
might more upproprLatoiy be called "Wallowing In the 
FfuiiUy." Tiin clTnct la largely attained by hia place- 
iivuit oi' t.iio I'ii'urna and by what may be termed the 
HI.'Tury I'lriiirnitij tn hia picture, such as the com¬ 
plete iic 1 ('-nhui)r])tton and utter indifference to each 
uthor of the im;inht;ra of the family who are shown. 
lUit the iimre furiiuil elemfints of color and design and 
drawliii, are- alao eJ'feciivo in creating the total im- 
XirntjaUiii. The dominance of the angular motif in the 
lie sign and the cold inharmonious colors, coarsely 
laid on, heighten the expression of the artist's in- 
tonacly disagreeable conception of family life. The 
distortion of the figures and the peculiar perspec¬ 
tive work to the same end. By the piling up of such 
effects the picture achieves powerful expression. 


Beckmarui ri'Kards I'uml.ly 1,1,fc as 

1 unJntereutlnK. 

2 stimulating. 

5 diutaotcful. 

4 amusing. 

5 beautiful. 

The writer's attitude toward 
Beckmann's view of family life is 
one of 

1 agreement. 

2 disagreement. 

5 indignation. 

4 surprise, 

5 amusement. 


5 . The color and design of the painting 
reinforce its general effect because 
of their 

1 beauty. 

2 boldness. 

3 harshness. 

4 intensity, 

5 gracefulness. 

4. The lines in this painting tend to take 
the form of 

1 sharp angles. 

2 gentle curves. 

3 twisting curves. 

4 slanted lines. 

3 disagreeable figures. 




rOi 
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CONCMAIJ-:!) l-’ICURKG 


Dlrcrtioti!.: TU*' ‘j u!' b'-low are almiiar to the ones you did in 

t hP in ev<;ry row of doolgns the figure is concealed 

in at b-aot uu- irawiuf*, nud iiviy be in aa many as all four. Put a plus (+) 
in the narrntii''! c:-, behiv h drawing if It contains the figure . Put a 
mitiua (") In tl‘*“ ntheoeri below a tlrawing if it does not contain the 

filinia;. 
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SPATIAL ORIEMTION 


Dirc-clioiiLj : Tho 6 iLciiii] belov are similar to the ones you did in the GUItFORD- 
ZIMMI®IAN AFI'ITlIDpj hlIRVl?Yj Spatial Orientation test. Blacken the answer space 
which shown how i.ho pool Lion of the boat has changed in the bottom picture from 
its oripitii'il poi’iLion in tho top picture, 


(tlincr Idle 6 ilcitii'i actUc'illy used in the interview came from the body of a 
cojjyi'iphLi'd IcsL, they arc noL reproduced here. The 3 items below are reproduced 
I'roiii Lh(' Li'cL dlrcclions.) 
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MER SERIES 


Dirocbioni’/ . The 5 prolileiiis Iselov are similar to the ones which you did in 
Lho NIIMBI'IR StlRIEu test. In each line below^ find the rule and circle the 
nuiiiher al the which is the next number in the series. 


Series 


Next Eumber 


1. 12 111 10 7 9 5 2 

2, 17 19 18 9 7 10 5 

3 , 27 21) 29 30 28 32 33 

4. 2 9 15 3 7 10 5 

3 6 9 5 10 13 


6 4 5 7 0 

20 8 2 3 12 

37 29 31 33 3 5 

12 1 11 2 6 

9 l6 


5 . 


7 


8 21 19 
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MABKS 


Directions; The prohlems below are similar to the ones you did 
in the MAJRKS teat. For each problem find the rule by which the 
mark is located in the first 5 rows. Using this rule, put a mark 
where it belongs in the sixth row. 






MIX B 


Inturvicver Rating Foms 




Latjt 


First 


Middle Initial 


NAME: 


EXPERIMENT IN PROBLEM SOLVING TECHNIQUES 
(interviewer Hating Forms) 


Educational Testing Service 
Princeton, New Jersey 

Project jlvl-ll 
sponsored ty 

The Office of Naval Research 

1961 



math 


a) 

b) 

c) 


cl) g) J) 

e) h) k) 

f] _1)_1) 
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a) Rertaten; the; tilviam and 125 l ^5 E = r 

vantiMln iu own vordn. 

b) Scemr, to bo having trouble underotanding 12 5^5 ^ = [ 

^Tprobif.'m (2 or more readings). 

c) Saye. he';; having Lrouble 1 2 3 1)- 5 2 = [ 

undo rotanding a probleiiu_ 

d) Any Indication of mlnrcading v _ f 

(wrong annwer but math o.k., 125 5 - I 

overlook!; a pointj eLc.). 


e) Han troviblc; decidlni'; on a 

method I'ur i.olvTng a problem. 


12 3^5 2 = 


f) ChiejiaiJug, (;ru(l(! c!,bliiui.t 1 on, 

fKdii’cn buck iroiii alternativeB. 


12 3^5 £ = 


g) Computofi aru'.wf’r and finde 
that it In wrong. 


h) 


Clirc.l:!', niiii'./i'i'. (.il'lur lie c.ireJes 
it, or al'Lcr he id.at.cf. iin .arinuer.) 


12 3^5 2 = [_J 

1 2 3 5 2 = I J 


1) Syatem on // 3 ^ 

3, volumetric Y N 

4. algebra or !f N 

diagram 


31 , liY 
3N, 4Y 
3Y, 4K 
3N, 4N 



j) bid you have 

1 Lem 1 


. trouble with any of the problems that you anewered? 

4 3 S = I_J ■ 


3 


If Yes" 

V) 3Id you have trouble beeauee you didn't knov what e«thod^o use 
' S bLLae you didn't underetand what vae wanted- 


O' 


didn' t 


1) on the problems that you didn't ^ ^o/becaule yo^SL-r^SrsW what 
know what methods to use ’ 

was wanted__ Q2^ ^ 




CUBES 


-0 

V)) 


'0 

^1) 
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a) 


r.RUtiiutTM C Hl wn'ih. \u-»'d 
(N- G. for 1 rube (l>; 


lu f:ubo c-.oiripari sons ■ 
c;riptLon only) 


L = 


adjaconL 
anyic 
axl i; 
baae 
bottoja 



I’Olni'.j ding 

edge 

parallel _ 


corner _ 

horizontal 

pe rpendicular 


CO rrt; spondlng 

inverse _ 

quadrant 


ciockwiso _ 

line _ 

side 


diaf'onal _ 

opposite _ 

symmetry 


top 

vertical 

vertices 


other 


t) vicuali xati on Ind i cat! onu used in cube comparlBona. 
(N, G. for 1 cube dof.cr Lption only) T. - 


Movemonts 

hand and/or 
pencil 

paper and/or 
body 


Mental imnipulationB 

flip (over, around) 
move *, tip 
siving it around 
turn, rotate 
I picture it turning 


Conclusions 

looks all right _ 

can see that it’s (not) o^k. _ 

that's (not) the same _ 


other 


c) Reasons for answers. (Base the ratings on explanations.) 


geometrically 
analyzed cube 
c ot iiparl.cona , 
answer is 
dinlueed from 
the j’elatlons 


(item If) 

© 


answer deduced 
from comparison 
of the exact 
positions of 
faces, (with or 
without geometrical 
analysis of indivi¬ 
dual cubes) 


(item #) 

© 


answer drawn from 
the use of 
pointing words , 

(X will be here, 
y will he here, 
etc.) 


(item #) 

© 


no descriptive 
comparisons , 
impression, looks 
right, (rotate 
this way and X is 
in the wrong place.) 


(item #) 

© 


1 ) 


- , P separate 90 ° rotations of the cubes, or that you 
Would you say that you make P ^ across their corners? 

visualize only one movement of the cubes a 

TnnT(> 1 than 2 always 1 


always 2 or more more 2 than 1 





© 


(D 





punched iioieb 


c) 


e) 

f) 


a) 
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a) Elaarcu llu; number of hole a or folds required. (Figures total first (o^ 
number for suceeuuive steps) 

1 , Yog , No _ 

2. Yes _ , No _ a. Yes _ , 1. Yes, 1. No _ , 2 No _ 

G) ©CD 


b) Says that he has a system for doing the items Yes , No 



Only count s tatoinenti. m;ule after a prellniinary analysis, 
c) Geomotrii-'al bennii used In solutions. E = 


adjacent 

comer 

horizontal 

pattern 

square 

angle 

corresponding 

Inverse 

perpendicular 

syioinetry 

axis 

diagonal 

line 

quadrant 

top_ 

base 

dotted 

opposite 

rectangle 

triangle _ 

botLom 

edge _ 

parallel 

side _ 

vertices 


other 


d) Visuallicatfon indications used in solutions. Z 


Movements 

hand tind/ or 
pencil 

paper and/or 
body 


Mental manipulations 

flip (over, under, around) 
fold (over, under, around) 
a fold, a crease, a bend 
paper, piece 
I see it unfolding 
(folding) 

r Just unfold (fold) these 


Conclusions 

looks all right 
I look to see where 
the holes are 
the holes will be 
here and here, etc. 
fold will produce 
this and this, etc. 


other 


e) Before you figure out where the holes will be, do you try to mentally 
fold or unfold the paper? No _ , Yes_ 

© © 


f ) Would you say that you spent more of your time working with the geometrical 

relations in the figures, or that you spent more of your time determining where the 
holes would be by mentally unfolding the figures? (a little or considerably more) 


much 

geometry 



i 


more geom. 
than vis. 


} 


© 


more vis. 
than geom. 


(D 


7 


much 
VIS . 









k) 

h) 


1 ) 

A 


V) 

.1) 


T.m'ic H .- -- 

a) i'irtX-. 

Hr in,',: !i . _ , . „ . > 

ici pi'titii"iii ('*;/) 

b) ol' 

tlun>'___ 

(itl'Ul il) 

ro 

c) Tlici // V)>:rin’i' Iv! ©'fctJ It. 

> iiTJ. ” ■'i"j. 'cz 
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Anal y/.f,', Q::t _ 

(item /jf) 


flhort 


Scans 

item 


(item //) 

© 


d) WorK ■ 

" only 

II ji. 


ti) 

A) 


ultnrnateu between 
Hjii and ucorinint' 
(Juut look for it) 

(item //) 

Ci-) 


(item #) 


Long 


(item #) 

@ 


. 1. I I . 5 


s = 


only 

scanning 


(item #) 

© 


e) Annwei'ii by Lnidi'oLi iitun of the pattern. 

(haua't any fj'isioti ior bin choice) 12 5^5 

f) ijayn h'-':. gvieiniliig. 1 2 5 5 Z - [ J 


£ = 


g) Woiild you nay that yun begin by trying different ideas or that you begin by 
neaniilii/'; an item. (Sutiiet 1 nk.*u or always) 

aLwayii now;tlii«n-, nome times always 

idetu: Id-aii _ ucun _ scan - ■ 

ViV “© @ ® 

h) Would yiii. nay tliat. yon spent more of your time trying ideas; or that you spent more 
of your time tu.'unnlnk; the letter groups waiting for the answer to pop out at you? 

(a little or connlcU'i'ubly more) 


always 


HiB 


mure 

tlian scan. 


more scan, 
than 


always 

scan. 


& ' © " ® © 

J ) will ycu tell »o the Idea, vhleh you voald “r^' 

to Itimo on’a teat of this .ortl (With paper tamed oy.r) E |-1 


alpdi/ibetlcul order 
reverse alph, order 
alternation 
progreetiioti 


common letters 
single 
double 
triple 
varying f 

combinations of the ones mentioned - 


skip letters 
vowels 
consonants 
position 


Y® 9 

J) Do you nne the.-;p ideas in about the sanic order each time?, 


, No 






SUHFACE DEVE1/3FMENT 




1.) Geometrical worda used in solution. 


£ = 


□ 


adjacent 

corner _ 

horizontal _ 

rectangle _ 

angle 

corresponding 

inverse _ 

side _ 

axis 

diagonal 

line _ 

s quare _ 

base 

dotted 

opposite _ 

symmetry _ 

bottom 

edge 

parallel _ 

top _ 

coinciding _ 

follow _ 

perpendicular 

triangle _ 


vertices 

work 

around 


others 


t) Visualization tndlcationB used in solution. 


Mo vements 

hand and/or 
pencil 

paper and/or 
body 


Mental manlpulationa 

flip (over, under, around) 
fold, bend (over, under, 
around) 

a fold, a bend, a crease 
paper, piece, surface 
up and over, down and 
around, etc. 
tuck, close, construct 
I see it folding (bending) 


Conclusions 

folding will produce 
this and this 
it looks right 
this goes here, and 
this goes here 
can see that it's o.k. 
I Just look at it and 
write down the answers 


other 


c) Reasons for answers . 


strictly 

geometrical 

analysis, 

(angle s, 
the like (^j 
tracing 
around) 

some geometry __ 
or tracing (^d^ 
some folding 
action reasons 

all folding 
action 

reasons 

Just looks 
at it and 
sees the 
answer, 
impression 

(item ^) 

(1) 

(item jf) 

(2) 

(item #) 

(D 

(item #) 
® 


d) Do you begin work on this type of item by 
mentally folding the cut-out? 


No _ , _ 

® © 


e) 


Would you say that you spent more of your 
relationships in the diagram, or that you 
the cut-out to see where the pieces fit? 


time working with the geometrical 
spent more of your time mentally folding 
(A little or considerably more) 


much 

geometry 


more geom. more vis. 

than vis. , than geom. ____ > 


much 
vis. 




VERBAL ANAI/)G1ES 


a) 


c) 


e) 




a) Tht! numbiir of comparative characteriatlca of the stem words stated 
(DofinitLons of only one word - N. G.) 

Tally 


Item_1_y_5 ^1- 


Initial 





II = 

n 

L _ 
n ~ 

Other 

_1 


1 



-BT- 


h) 100 - time spent on the stems initially. 
Item_1 g j 4 


Seconds 





L 

on .stem ' 





Total time 


on the 4- 
iteras 


100.0 



c) Altornativou 

Lenta Li VO 
ar.ccjptant'c 
and/or 
rejcM’tlou, 
l-l; in order 


tentative 
aecupLance 
und/or 
re JoeLion, 
any order 


scans test, 
rejects one 
or two, then 
makes a 
choice 


scans list, 
chooses one, 
then 

eliminates 
some or all 
others 


scans list, 
chooses one, 
sees it 
right off , 
doesn't 
eliminate 


scans list; 
chooses one, 
impression; 
vague , no 
eliminations 


(item II) 

© 


(item /) (item 

® @ 


(item #) (item #) (item If) 

® © © 


d) Gives a reacon for his answer. 


(item If) 

® 


Wo 


(item #) 

© 


e) Wiicn you uLurt (^olng through the options, do you figure the re.lation3hlp in each, do 
you simply ('honk each for a relationship which you found in the stem, or do you scan 
the optloriB to see if something will pop out at you? (Sometimes or always) 


always 

relations 

always 

checking 

sometimeB 
relations 

sometimes 

checking 

sometime s 
scanning 

always 

scanning 


© 

© 

© 

© 

© 

f) Would you say that you 
or that you spent more 
out at you? (a little 

spent more of your time figuring and checking relationships, 
of your time scanning the items waiting for an answer to pop 
or considerably more) 

much 

relations 

) 

more rel- 

than scan. , 

more scan. 

than rel. 

much 
, scan. 

1 

( 

© 

© 


@ 

® 




cahd:3 


>■) 

r) 


h) 


i) 


-D8- 


h) 

lO 


■) 


a) 


b) 


c) 


( iin-.'ui.'i. I yi.t I’ <)f ami I:.t <i.l Luj-tiaLlvt! toccther) 


('I'(III.'' I 

i)rial m!' 
iitcin i’n'.M, 


I'-aa.. t.hi-n 

'lu'i. 1 y., i;I of ol.oin 


i'.voi,-., uiiaJytjii; 
of oU'rn fir;;t 
^'lia.lc'o on Uio 
l.-ft") 


ocu-tiLi atotij 

thon 

utiuLyojH of 
ofi.m. 


gjlancea at atom 
and immediatoly 
begins on altei’- 
natives 


(LLom fl) (Horn //) 

n) 

Geoioitrical Analyolij; 

i. stetii__ 

Q. altoiTiat, i VOS 


(Item 

(item //) 


(item y/) 

@ 

© 


© 

1&2 

2 

1 

none 

© 

© 

© 

© 


Suytj tliiit, Ijo ))as a syaLuiri for 
doini^ the jtciiii;. 


Yes _ j No _ 

© © 


Terms UMjfi at any tiiiit': 


d) 


GeometricaJ tejrma uiiod to decide on alternatives. S = [ 


adjacent. 

coincJ dJng 

dJ agonal 

line 

g.uadrant 

angle 

come r 

edge 

opposite 

reverse 

axiii 

corresponding 

follow 

parallel 

side 

base 

clockwJ be 

horizontal 

perpendicular 

symmetry 

bottom __ 

clirvo _ 

inverse 

precede 

top _ 


otlier 


e) Visualization indications used to decide on alternatives. 


L = 


Movements 

Mental manipulation terms 

C’onclus ions 

hand and/or 

flip, turn, swing _ 

flip over and the 

pencil 

rotate (over or around) 

hole's o.k. _ 


paper, piece _ 

looks right, fits _ 

paper and/or _ 

I see it turning 

Just flip them over _ 

body 


that is (not) the same _ 


other 


f) Uses a rejecting characteristic 

@ (Item #) 


rejects by Impression _ 

0 (item #) 


g) Accepts by using a rule _ 

(item #) 

© 


Accepts by visualizing the 
rotation 

("just see it," rotate 
and look) 


(item i) 

© 


b) 

i) 


Do you begin by figuring out a rule for the geometrical 
relationships in the stem? 


Yes _ , No _ 

© © 


Would you say that you spent more of your time figuring the answers from rules about 
the geometrical relationships in the cards, or that you spent more of your time 
mentally rotating the cards and checking to see if they looked right? (A little 


or considerably more) 
much more geom. 


more rot. 

much 

geom. , than rot. 

7 

than geom. , 

rotation 

© 

© 

© 

© 





BEADHKt _bj_djj_ 

a) of time spent reading paragraph. 


Reading (se conds, 
Total 


b) Reads paragraph first _ , reads questions first 

c) Answers the questions as he reads. No _ 

d) Uses underlining or other observable notations. 


_ © ■ 

_ © • 
© , No 


Figure s 

Reads 

Finds 

Reads 

Reads 

Heads 

Reads 

out 

alter¬ 

answer 

alter¬ 

alter¬ 

alter¬ 

alter¬ 

answer 

natives, 

in the 

natives. 

native s , 

native S j 

natives. 

before 

and then 

context 

tentative 

tentative 

no choice. 

no choice. 

looking 

figures 

before 

choice, 

choice. 

then finds 

then tries 

at the 

answer 

looking 

then finds 

then tries 

answer in 

to spot 

alter- 

before 

at the 

answer In 

to spot 

context 

alter¬ 

natives 
or the 
paragraph 

looking 
at the 
paragraph 

alter- 

natives 

context 

alter¬ 

native 


natives 

(item #) 

(item #) 

(item #) 

(Item #) 

(item #) 

(item #) 

(item #) 

© 

© 

© 

© 

© 

© 

© 


f) Scans the list first. No _ , Yes _ 

© (Item#) © (item#) 

g) Tentative acceptance or rejection: 


In order _ 

© (item #) 


Not in 
order 


Doesn't 
do it 


© (Item #) 


h) Gives reason for answer, 
(or remembers) 


i) # of returns to paragraph, 
(before he gets the answer) 


, Some _ , do it _ 

(© (item #) © (Item #) 

Yes _ , No _ 

© (item #) © (item #) 

12 5 ^ 


j) As you read the paragraph, did you try to note particular points, or did you read 
it straight through for the general impression? (A little or considerably) 


note note impression impression 

considerably _ , little _ , little _ , considerably_ 

© © ® ® 

h) Which do you usually read first: the paragraph or the questions? 

Paragraph _ , Questions _ 

© © 

l) When you start going through the options do you usually have an idea of what the 
answer should he and then Just look for it, do you reject some and tentatively 
accept others, or do you scan the options and wait to see if something will pop 

out at you? idea already rejection and scan options 

tentative acceptance 


© 





-BIO- 


CONCKATJBD FIGimKI> 


a) 


a) RolatJvu fliXMjd 01’ arc apian ot* and r*\1ontIori. 


far. Lor 
rojocilon 


about the 
taame cpaed 


faster 

acceptance 


b) Uses a rejecting ch/iracteriatic_ , rejects by Impression _ 

(item //) (item f) 

Q © 

c) Accepts part by part _ j Accepts by Buperlraposing _____ • 

(spoken or traced) ("just sees it") 

d) Illuelona (independent of right or wrong marking) . 

not BiQved j not slowed , la slowed , Indicates trouble 

aaya acknowledged says seeing whether or 

nothing the illusion nothing not the figure is 

and Ignores present when it 

it has an illusion 


(item i^t) 
® 


(item #) 


(item //) 

@ 


(item #) 

© 


e) if ot correct figures with an illusion which were marked — 

tally I I 01254 


f) Point to the four figures which were most confusing for you. (Count if they 
contain illusions.) 

tally I I 01254 

a) Do you think that you mark the right ones sl^er _ , about the same 

speed as (5) , or faster than _ (^j 7°^ the wrong ones? 

h) When you decide that a figure does contain the original, do you your 

decision after looking for specific parts of the original (l) » or 

iiia+ -hT-ir +.n Rpp t.Vip whnTR original figure in it (2)7 


do you just try to see the whole original figure in it ‘ 

1 ) When you decide that a figure does not contain the original, d^ou make 

your decision after looking for specific missing parts _ (l_) , ^do 

you decide by Just seeing that the original figure won't fit _ (2^ 7 






il) 

iil 


‘0 

iil 


e) 

1 ') 


-BH- 


SPATIAL OKIKflTA'rJOH 


&) 


a) Meelmn icu.l I’nlc fox’ tinfj;!*; of tilt given before aolutions are atarted. 
(If~>njf.ii>i>en :'.j It tni;anij ttot ..•) 




Ye 



/ 



GecDine triofil tex-rns used in Bolutlons. X = 


adjacent 

coinciding 

diagonal 

level 

angle 

cQi’ner 

edge 

line 

axi s 

coi-re spending 

horizontal 

parallel 

bottom 

clockwise _ 

inverse 

perpen- 


dicular 


Other 


aide 

square 

top 


c) Visualization terms used in solutions. 


^ = cn 


Movements 

hand and/ 
or pencil 

paper and/ 
or body 


Mental Manipulations 

flips (up^ dovnj over) 
straighten out^ twist, 
turn, swing around . 
rise, come up, above, 
fall, below, drop 


Other 


Mental Manipulations 

throttles up or down 
advances, comes closer, 
backs off 
I picture (see) it 
moving 

I imagine myself in 
the boat 


d) Eliminates alteraatlves by- 
figuring factors separately. 


Yes 


(item #) 


No 


(item #) 

(D 


e) Notices that the answer 
for Item 4 is not given. 


© 



f) How do you figure out the way that the boat has tilted? Do you use a 
rule based on the geometrical characteristics of the pictures, or do 
you visualize the boat being driven? 

rule _ (l) , visualize _ (2 ] . 

g) Would you say that you spent more of your time -working with the geometrical 
relationships between the sets of pictures, or that you spent more of your 
time figuring the answers by visualizing the boat being driven? (A little 


or considerably more) 

Always more geom. 

more vis. 

al-ways 

geom. , than vis. 

, than geom. 

, vis. 

(T) 

r?) 



(V) 





DUMBER skrik;; 


h) 

■) 


■ 1 ) 

'•) 

n 


FJ 

h) 

i) 


j; 


a) Fii~!it: Ri-lrit<Hiu:-,i!i 51;; 


b) Work on Uh' t ti-tn 
All ro lutioriiihipu 


.'■R-anul rii«; 


(i 

Oj 


(itfITl 

( 2 ) 

Altomates bt:tweejn relations 


(Item a) «oannlna 

G) 

c) The number of rtilatiormhlpp figured- 

_____ } Some . None 


(item #) 


(item //) 

Q.) 


(item //) 

G) 


(item #) 

@ 


d) Anaverti by imxiretsIon of the pattern. 1 2 

(visually sees itj or thinks he has figured 
it out.) 

e) Looks for skipping patterns. 1 2 


f) Length of scanning time . 
None 


Short 


Long 


(item #) 

© 


(item #) 

® 


(item #) 

® 


g) Says he's guessing- Item 1 


Z = 


dllr’- 


h) Flexibility (uses multiplication and/or division on items 2., k-, and 5 ) 
tabulation 

2 Y N 2j k + 5 _ 4 __ ( 4 } 

4 Y N 4 + 2 or 4 + 5 _ (^ 2 or 5 _ 

5 Y H 2 + 5 _ (5\ none _ 


L = 


L = 


i) Would you say that you start by figuring relationships^ or that you first scan the 
item to see if a pattern is readily apparent? (SometimeB or always ) 

Always sometimes sometimes always 

relations _ , relations _ , scan _ j scan _ 

© © © © 

J) Would you say that you spent more of your time figuring the exact relationships 
between the numbers, or that you spent more of your time scanning the items 
looking for a pattern in the numbers? (A little or considerably more) 


much 

more rel. 

more scanning 

much 


relations , 

than, scanning , 

tha-n rel. , 

scanning 


© 

© 

© 


© 





M/UiKi' 


Si 


i) 




) 


■0 

1 .) 


'0 


n) 

h) 


a) Fit'!.!; 



hrlng.ii 11 jj. __ 

, Afialyi.ei! Int 

, Elcarin 


t.n [iroliit'in (it.i-ra //) 

(J.tMn 

1) (llrmf) 


A,, 

© 

6 ) 

K) 

Length of sennnlng tlmi': 




Noni' 

, lihorb J 

Ixing 


(itim //) 

(item //) 

(item #) 


CO 


(© 

c:) 

The // of JlyU tried before he gebu It. 



1 I 1 > « 1 

■ ■ 1 . I . 

1 .1 ^ = 1 . . • 

a) 

Work on the item: 




onjy 

alternates between 

only 


”i^ 

and scanning 

acanning 



(just look for it) 



(J Lorn 

(J t-eih //) 

(1 torn #) 


© 

© 

® 

<0 

Answers by Impt’escion of 

the pattern. 



(hasn't any reason for 

hie choice) 1 2 

t> U £ = 1 1 

f) 

Gays he's guessing. 

1 2 

3 £ = 1_1 


g) When you ebarted on a new item did you flrsb try different ideaa or did you first 
acan through the Item to see If you could find a pattern? (Always or Boraetimee) 


always 


aometlmea 

sometiineB 

always 

ideas 

> 

ideas , 

scan , 

scan 


& 

( 1 ) 

6) 



h) Would you nay that you spent more of your time trying different ideas, or that 
you spcnb more of your tJme scanning the items looking for the pattern? (a 
little or cousiderably moie) 


i) 


all ideas 



more ideaa 
than acan. 



7 


more scan, 
than ideas 



all scan. _ 


Will you tell me all of the ideiia will ch you tiy in oi'der to figure out the 


answera to itema on a tea 

count froiri end _1 

pocifJon In a group _ 

liL'/.e group it's In _ 

re LaLI on to gap __ 


of this sol' tv 

which of given size 
group it is in 
look for alternating 
position with group 


numerical pattern down 
through the rows 

£ = l-1 


Yes _ , 


Wo 


j) Do you Lalu; these lu iibouL Llu’ some order each time? 


© 







APPEDIX c 

Questionnaire 




-Cl- 


Educational Testing Service 
20 Nassau St., Princeton, N. J. 

Study of Test Taking Methods 


Name __ Age Class 

Major (or expected major) 

Father'a Occupation _ 

List your out-of-school hobbies and Indicate the extent to which you have been in¬ 
volved in these activities. 


List the extra-curricular activities in which you have participated (high school 
and/or college). 


Which of the fallowing mathematics courses did you have in high school? (Check) 

ls-6 yr. Algebra _ Trigonometry _ 

2nd yr. Algebra _ Introductory Calculus _ 

Plane Geometry _ Other _ 

Solid Geometry _ _ 


How many semesters of mathematics have, you had in college? 


How many semesters of applied art (painting, drawing, etc.) and mechanical drawing 
have you had? 

9th-12th Grade College 


Applied 

Mechanical Drawing 


How many semesters of each of the following have you had in college? 

Engineering (other than mechanical drawing) _ 

Ar chite cture 


Please rank the three types of tests listed below according to how well you think 
you generally do on them, in comparison with your fellow students, (indicate: 
1 st, 2nd, 5rd) 


Tests of mathematics and reasoning 
Tests of visualizing and space 
Tests of words and reading 





-C2- 


How did the way that you worked items on the tests compare with the way that you 
worked the similar items during the interview? 

About the same _ 

Differently _ 

(if differently^ pheck any and all applicable 
descriptions.) 

_ discovered different methods for several 

tests during the interview. 

_ was much more systematic in the interview, 

_ was much less systematic in the interview. 

tend to think much more clearly aloud, 

_ tend to think much less clearly aloud. 

Name 1, 2 or 5 occupations that you think you might like to enter after graduation 
from college, 


Name 1, 2 or 5 occupations of college graduate calibre that you think you would 
particularly dislike entering. 


Considering the different ways in which test problems may he solved^ please write 
below anything which you think; 

1, describes the ways in which you solve test problems. 

2. distinguishes your methods from those of some of your 
fellow students in college. 







Intercorrelations of 15 Tests for the WholesGrotp' 







Te st Name s 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

ill-' 

‘ 12 

^13 

l4 

15 

1. 

Vocabulary 


6o 

26 

27 

4l 

23 

72 

46 

13 

72 

31 

31 

35 

35 

16 

2 . 

Math. Problems 

60 


34 

48 

46 

4o 

59 

58 

36 

60 

42 

42 

42 

64 

29 

3. 

Cubes 

26 

34 


46 

4l 

57 

29 

38 

47 

39 

47 

46 

45 

15 

22 

4. 

Punched Holes 

27 

48 

46 


35 

61 

30 

45 

52 

37 

60 

57 

49 

31 

37 

5- 

Letter Grouping 


46 

4l 

35 


30 

39 

43 

39 

43 

45 

44 

32 

50 

30 

6. 

Surface Dev. 

23 

4o 

57 

61 

30 


30 

39 

66 

30 

61 

59 

56 

10 

17 

7- 

Verbal Analogies 

72 

59 

29 

30 

39 

30 


48 

26 

72 

31 

38 


37 

26 

8. 

Ship Destination 

46 

58 

38 

45 

43 

39 

48 


37 

53 

49 

52 

45 

4i 

45 

9. 

Cards 

13 

36 

47 

52 

39 

66 

26 

37 


23 

58 

50 

47 

24 

24 

10. 

Reading 

72 

60 

39 

37 

43 

30 

72 

53 

23 


36 

36 

44 

37 

28 

11. 

Concealed Figures 

31 

43 

47 

60 

45 

61 

31 

49 

56 

36 


56 

50 

29 

35 

12. 

Figure Analogies 

31 

42 

46 

57 

44 

59 

38 

52 

50 

36 

56 


56 

32 

31 

13- 

Spatial Orient. 

35 

42 

45 

49 

32 

56 

42 

45 

4? 

44 

50 

56 


29 

32 

i4. 

Number Series 

35 

64 

15 

31 

50 

18 

37 

4l 

24 

37 

29 

32 

29 


29 

15. 

Marks 

16 

29 

22 

37 

30 

17 

26 

45 

24 

20 

35 

31 

32 

29 



Meansj Standard Deviations^ and Varimax Factor Loadings for the Whole Group 



